required to prepare guidance for applying quality control methoda a^^ 
techniques to Oovemment quality assurance requlreiiients aaid for ' 
developing the required policies for their application will soon ^ 
available. When that stumbling block has been overcpine, we hope |o 
continue to promote flexible but uniform practices, and thereby a higher 
degree of efficiency in our procurement program# 
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GThese Transactions constitute a record of the presentations 
at the National Convention. They have not been subjected to review 
by the Editorial Board of the Society. The timetable for plahnihg 
our conventions precludes this at the present tiiae. After the 
Convention^ the papers will be reviewed by the Editorial Board and 
certain of them may appear in ’Tndustrial Quality Control.’* 

If you agree with the thoughts expressed on page VII/ why not 
add your expression of appreciation by telling the authors how their 
papers liave been of help to you. They would like to know. 

Request for permission to reprint any portion of these Trans- 
actions should be addressed to Professor r.!feison E. Wescott , Chairman, 
Editorial Board, University College- Rutgers University, New Bruns - 
\Ti.ok;. Jersey. 

TJhile these Transactions are copyrighted, the toerican ^ciety 
for Quality Control assumes no responsibility for any of the authors ' 
statements. Responsibility for the content of each paper resides 
with its author. 


Edward M. Schrock > 
National Transactions Chairman 
General Convention Committee 
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A TRIBUTE TO OUR AUTHORS 


We a3.1 tend to take for granted soub of the finest aspects of 
our hiomn experience. One that affects us each year at this iime 
is our National Convention Transactions. True ve pay a simll purchase 
price for the volume; but this is only to cover the costs of publi- 
cation and distribution/ Our authors not paid. 

Preparation of their manuscripts for publication is no simple 
task for oijir speakers. They are busy people. Some have limited 
stenographic services available. Some become sick just when they 
had planned to prepare their manuscripts. Some are given new: or 
special jobs that greatly Increase their responsibilities and work 
load. Some change companies while preparing their inamiscripts. And 
in addition we give them a lot of detailed rules to follow in pre- 
paring their papers - rules which sometimes on the surface must 
appear unimportant and burdensome. 

I'/hy do our authors go to so much trouble to prepare manuscripts 
for us? There are probably as mny different reasons as the^e are 
authors. Some of them; of couse ; will be concerned with the indivi- 
dual's desire to improve his professional status in the quality 
control field. But in every case there Is a generous amount|ipf 
self-sacrifice and desire tp help others work more effectively in 
dealing with their quality control quality problems. 

So our hat is off to our authors. You are a grand group of 
people. 
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D. S. MciUrthvqr and Jr J. ^ 

Es0o Research and Engineering Company 


Abstract 

This paper discusses strategy in empirical research. Several re- 
search teams have done empirical research on electrical ana],ogs of re- 
search problems where a random, noimally distributed error ^s intrp- 
duced to measurements pf the dependent variable « The success attained 
with different strategies has been observed. Designed experiments are 
"better" than the one-variable-at-a-time str^ However/ the "best" 

strategy is not known. 

The work pointed up mistakes we are apt to make in doin^ research: 

We aren^t always bold enough; 

We are apt to get in a rut; 

We are too easily fooled by the error; 

We don’t always eliminate the unimportant 
variables first; and 

We don't always know when to quit. 

Some of the "elements" which will probably be found in the ?best" re- 
search strategy are Suggested. 
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I. DOING "RESEARCH OK RESEARCH' 


This paper is concerned with strategy in empirical research* We 
have done some "research on research" using simple electrical analogs 
of research problems . The effectiveness of different empirical stra- 
tegies, used by different research teams, has been compared* So far, 
the research has simply consisted of observing how the different stra- 
tegies seemed to work out. As the work progresses, we hope to deline- 
ate research strategies in sufficient detail to program them on a high- 
speed computer* In this way, a particular research strategy could be 
tried out a large number of times (on different kinds of problems) 
until an "eagpected payoff" for that strategy could be obtained. Work 
of this type (with the help of the mathematicians to suggest different 
strategies ) may develop new methods of doing en^irical research which 
are more economical and effective than our present methods. 

II, THE "LITTLE BLACK BOXES" 

A research problem can be thought of as a "little black box". The 
box has dials (variables) on it which affect a meter reading (the de- 
pendent variable). The problem is to increase (let's say) the meter 
reading. If we are to do basic research on the problem, we take the 
box apart and study each component in detail. We learn exactly how 
each part works and how it interacts with the other parts to produce 
a change in the meter reading. If we are to do empirical research, we 
study the box from the outside. We move the dials and observe what 
happens to the meter. 

We have made "little black boxes" and done empirical research on 
them. In these boxes, five dials control a meter not seen by the re- 
searcher. He runs experiments on the system and gets test results just 
as he would on a read problem. In real problems the results contain 
an "error". This is because only some of the many factors affecting 
the system are being controlled. The uncontrolled effects make the 
dependent measurement subject to random fluctuations (error). The ran- 
dom fluctuations were introduced, in these models, by the plant "opera- 
tor". He superimposed random, variations on the meter reading in accord- 
ance with values drawn at random, from a deck of cards containing 1000 
normally distributed deviations. 

The analogs used in these studies are single internally. They are 
electrical resistance networks powered by batteries. Dials indicated 
the settings on variable resistors. The output was a voltmeter reading. 

The units were housed in two electrically connected boxes: One 
contained the variable dials and was used by the experimenters, the 
other contained the error dial and the voltmeter and was used by the 
plant operator. The boxes were oriented so that the research workers 
could not see the voltmeter (l.e., they were not permitted to optimize 
by twiddling the dials with an eye on the voltmeter). Figure 1 shows 
a three -man team doing research on one of these systems called the 
ALCOHOL PLANT. 
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DOING RESEARCH ON THE ALCOHOL PLANT 



A. The ** ALCOHOL PLANT" 

This model represented a hypothetical alcohol plant having a yield 
of The yield was affected by five variables k, B, C> D, and E. 

Two versions of the ALCOHOL PLATO were used in experimental work* They 
were identical outwardly but differed in internal wiring* The first 
model had relatively simple relationships between the variables (not 
many interactions) but a large unknown error (standard deviation of kia, 
absolute value) in the yield measurement* The true relationships be- 
tween the variables were as shown in Figure 2* There was an interaction 
between variable B and E* Variable D had no effect on the system* 

The second version had more complex relationships between the vari- 
ables as shown in Figure tut had a smaller known error (standard de- 
viation of 2*55^, absolute value) in the yield measurement* 

In both ALCOHOL PLANT models it was desired to increase the yield 
from the plant by doing empirical research work on it. 

B. The SNAFU Unit 

A small amount of work was done on another model called the SNAFU 
Unit containing six variables. This was intended to simulate a pilot 
plant \mit which would be available for study for a limited period of 
time only* It was desired to get the maximum amount of information on 
how to operate the unit in this fixed time (enough time for kO test 
runs)* Four of the six variables were continuous (like those in the 
ALCOHOL PLANTS), tWO “df them were discreet variables, one corresponding 
to three different feed stocks and the other to three different cata- 
lysts* There was considerable interaction between all variables* The 
error in yield response was unknown and relatively small (standard de- 
viation of absolute value). 

How The Games Were Played 

It is apparent that these models represented problems which are 
much simpler than real problems. The operating space was clearly de- 
fined — it simply consisted of the range on each dial (resistor)* 

There were no islands or inlets in operating space* The operating range 
on a variable was independent of the settings on the other variables. 
There were only a relatively few variables to consider in these problems. 
Most real problems would have more. There were no second-order inter- 
actions introduced into the models (although this was not known to the 
research workers). The economics were clean-cut; much more so than 
would be the case in real problems. 

However, the problems were sufficiently difficult to give many re- 
search teams trouble. We have been able to learn, even from these sim- 
plified problems, some of the mistakes we make in doing research and 
what type of approach seems the best. 

In the ALCOHOL PLANT models we provided a set of mythical economics. 
Each plant test cost $20,000. A 1$ in^>rovement in yield is worth 
$500,000 ($50,000 per year over the 10-year life of the plant). Each 
variable h^ a known operating range from about 0 to 85 dial reading* 

At tlie start of the research work each variable was set at 50 and this 
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FIRST ALCOHOL PLANT 
— EFFECT OF THE VARIABLES 
(TAKEN ONE AT A TIME -OTHERS SET AT 50) 



SETTING SETTING 








gave a knovn yield of 24^6, The research workers were told that the 
xnaxlmum possible yield from the plant was something less than but 
they weren't told what it was (it might be 25?^ or 49^)’.’ 

Research work was done on these models by individuals or by re- 
search teams competing against each other* The research team agreed 
on a strategy and decided on the plant tests which they wished to run* 
The plant tests were run off with the team making the dial settings 
and the operator introducing the random error. The plant result (yield) 
was read off to the research team by the plant operator. Usually where 
more than one played as a team, they were given time to work out their 
strategy. Many of the games were played by teams who had a week in 
which to work out their strategy and make their calculations* In the 
case of many individual players, there was little time to work out a 
strategy. The player spent less than an hour on the research work. 

III. HOW SHOULD WE COMPARE RESEARCH STRATEGIES? 

In the work done on the ALCOHOl PLAjNTS, we were faced with the 
problem of deciding on a criterion to use in comparing research stra- 
tegies. Three criteria suggest themselves. 

A. Best Yield From a Fixed B u dget? 

We might give each research team a fixed budget, say enough for 40 
tests, and measure their performance on the basis of the yield improve- 
ment they got with this budget. This means of measuring success was 
used in the case of the SNAFU Unit. It has the drawback that we do not 
know how big to make this fixed budget. Forty tests may be altogether 
too few, considering the large return possible on the Investment. On 
the other hand, we may be encouraging waste. Possibly most of the gain 
can be obtained in 10 or 20 tests and further refinements may not be 
worthwhile. This criterion does not leave the research worker with the 
difficult decision of when to quit research. 

B. Highest Return on The Dollar? 

We could compare strategies on the basis of the payoff per dollar 
spent. The strategy which produced (on the average) the highest return 
per dollar spent would then be judged the best one. If the researcher 
got a yield improvement of IO 5 &, for example, after r*unning 50 tests, his 
payoff (using the economics for tills plant) would be five million dol- 
lars for a research cost of one million dollars so that the return on 
research is five dollars per dollar spent. 

This has the disadvantage that by some stroke of luck (or good 
management) a team might get a yield improvement of 2 $ after running 
only four tests. The payoff would then be $12.^0 per dollar spent. If 
this team knew enough to quit research at this point, they might come 
away with the prize, even though there is still a lot for the Company 
to gain by upping the plant yield further* This does not seem like the 
best way for management to judge research efficiency. 

C. Biggest Payoff Over Competitive Research? 

In the ALCOHOL PLANT games, we decided that the best research 
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FIG. 3 

SECOND ALCOHOL PLANT 
— EFFECT OF THE VARIABLES 
(TAKEN ONE AT A TIME -OTHERS SET AT 50) 
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strategy is the one shoving the greatest retiirn above that which could 
be obtained in competitive research* Competitive research represents 
the average of all other research work. It has been said that research 
on the average will net about $5 dollars per dollar spent, e.g., a re- 
turn of $6 per dollar spent. The best strategy is then the one which 
will give the biggest payoff beyond this competitive reseeu^’ch level. 

On this basis, the team obtaining a yield improvement of lOjt in 
50 tests (which made a gross profit of five million dollars but spent 
one million dollars on research) had a net payoff of only four million 
dollars, whereas, competitive research (on the average) would have 
netted five million. This team lost money! They made one million 
dollars less than could have been made by spending the same money in 
competitive research. 

The team, making a 2 $ in^rovement in yield after running four tests 
made money, but not as much as they might have. They netted $920,000, 
whereas, competitive research on the average would have netted only 
$400,000 so that they beat competitive research to the t\me of $520,000, 
However, further research might have increased this margin over competi- 
tive research. The best research team will continue research until the 
payoff drops to the competitive payoff level. 

IV. COMPARISON OF RESEARCH STRATEGIES USED 


Sixty-one research teams experimented with these simulated re- 
search problems. Some of these teams consisted of one man only, others 
consisted of two or three men competing as a team. The competitors 
came from widely different fields of interest. JMhny of them were in- 
dustrial research workers, laeny were administrators (primarily from re- 
search), some were mathematicians, and some were new college gradimtes. 
Many different strategies were used. 


A. One -Variable -At -A -Time 

By far the most common strategy employed was that of changing one 
variable at a time while holding the others constant. Thirty-fovir out 
of the 61 teams used essentially the one -variable -at -a -time technique. 
This strategy was employed by almost all administrators, by new college 
graduates and by most of the research workers who had not had training 
in the design of experiments. The one -variable -at -a-time strategy 
seems to be the accepted way of doing research. 

B. Using Designed E3g>erlments 

Many of the research workers had been trained in experimental de- 
sign, although only a few had had practical experience in this field. 
The prevalance of the designed eaqperiment approach is undoubtedly due 
to this training. Twenty-one out of the 6l research teams made use 
of some sort of designed e3Q>eriment. By far the most common type of 
experimental design ^s the fractional factorial. Most people used a 
1/4 replicate of a 2^ factorial experiment for their first design. 

Lack of experience in the design of experiments and analysis of the 
data led to some difficulty in interpretation of the data. 



C. Box-Wllson Technique 

In at least two cases a serious Box- 

Wilson technique. This was done without previous experience in the use 
of this technique so that the results may not be truly representative 
of the payoff which should be expected in using this strategjr. 

D. Eliminating Operating Space 

Two or three teams employed the concept of elimination |>f operat- 
ing space. The first experiment in space was chosen through the use of 
random, numbers. When tMs was found to^^b^^^ an ® in 

operating space> random numbers were again used to choose a point in 
the remaining operating space. After each experiment, a volume was 
eliminated from the operating space and random numbers were iused to 
choose a point in the remaining operable space. This was continued 
until a good place was found* 

E. Other Techniques 

A few other techniques were tried, such as changing two variables 
at a time and employing the concept of randomizing interaction vectors 
between the variables. . , , , , 11.^. l 

P. Comparison of the Strategies 

The results' obtained by the various research teams On these models 
are listed in Tables I, II, and III. These briefly describe the stra- 
tegy used and show the result obtained in terms of the profit over 
competitive research. The results on the first ALCOHOL PLAH|J model show 
that people using the one-test-at-a-time strategy did as well, on the 
average, as those using some type of designed experiment, iuck seemed 
to play a major role in the success of the reseefch teams. Idost of the 
researchers had no idea of the size of the, error. Very few bf them dis- 
covered that variable 0 had no effect on the system. There was a 
general feeling of helplessness and frustration. Many of the teams 
felt that the error (standard deviation of 4^, absolute value) was 
ridiculously large, when they heard what it was. Act\;ally, It is re- 
latively no larger than the errors in meuay real problems on which the 
research teems had worked, it is the feeling of the authors that re- 
sesLTchers experienced in the design of eaqteriments would average better 
than those using the one -variable -at -a-time strategy on this model in 
the long run. £3q>eriments run by the authors using designed experiments 
generally showed a high return. 

On the second model (which had a smaller, known error) people using 
some form of designed experiment did much better, on the average, than 
those using the one-test-at-a-time strategy. The 16 teams usiiag the 
one -variable -at -a-time strategy lost 1.1 million dollars, on the aver- 
age, whereas the 13 teams using the designed experiment apprbach made 
0.8 million dollars on the average. Only 2 of the l6 teams using the 
one-variable-at-a -time strategy made money; 6 of the 13 teaais using 
the designed experiment approach made money. Luck still played a part 
in the success attained but it seemed to be less important here than in 
the first ALCOHOL PLANT model. 
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It was harder to show a real gain In the second ALCOHOL PLAKT* 
About half the people who e^qperimented with it made no appreciable im- 
provement in yield, although a l6*5lt improvement was possible. It is 
conceivable that we often miss making improvements in real problems by 
using a weak research strategy. 

Researchers using the designed experiment approach on the SNAIU 
Unit did better than those using the one-test-at-a-time approach. How- 
ever, insufficient data were collected on this unit to be certain that 
this would always hold. 

The Box-Wilson techniciue didn't show up to advantage over the de- 
signed eacperiment strategy in either ALCOHOL PLANT model. This may be 
due to a lack of experience on the peirt of the researchers, or to a 
weakness in the technique in problems with large experimental errors. 

Not enough people tried other techniques such as the random elimi- 
nation of operating space or the concept of randomizing interaction 
vectors to give these strategies a fair try-out. 

Further work is needed using well-defined strategies to obtain a 
good comparison between different strategies. Where the strategy can 
be delineated in detail, it might be possible to set the problem up on 
a computer. Thousands of trials with a certain strategy could then be 
made until a firm value is obtained for the ’’ej^ected return'’ for that 
particular strategy. The difficulty at present is that we do not know 
how to delineate the strategy in sufficient detail to do this. For 
example, no firm criterion has been set up for when to quit doing re- 
search work. In these games this was left to the judgment of the re- 
search workers. The work done so far suggests that the use of designed 
experiments by experienced people can beat the orthodox one -variable -at- 
a-time strategy used by experienced people. 

V. GENERAL OBSERVATIONS OH HOW PEOPLE DO RESEARCH 

A. Luck, Skill, and Judgment 

Three elements seem to be important in determining the degree of 
success. They are luck, skill, and judgment. Those doing well had a 
more -than -average share of at least one of these elements. Some people 
were lucky during their first runs in the program, that is, they struck 
high yield values almost immediately. Where they had the good judgment 
to quit research at this point, they made a sizable profit. The 
statisticians and mathematicians tended to depend less on luck and more 
on skill. The element of judgment, however, was still inqportant. For 
example, some statisticians made the mistake of covering too small a 
part of operating space. Some of them did not know when to quit re- 
search work. 

B. Emotions Aroused 

The same emotions seemed to be aroused in the different research 
teams. Usually, the team, started the game with great interest. This 
was followed frequently by a feeling of jubilation when they obtained 
a relatively good yield response. However, in many cases this was 
again followed by frustration when they discovered that they were 
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unable to clieek tbis yield value or to improve on it# 

The Mistakes We ^ke . 

Work with these models hsts pointed up some of the error|;s we are 
apt to make in doing our research work. 

- ^ . . .V. 

1. We aren't hold enough. For example^ many research teams never 
looked at half of the range on one or more of the variables The best 
value might lie in the . range not studied. Other teams started off with 
steps which were too small v 'They investigated a smaiLi range around the 
starting point rather than first making a sketchy study of the entire 

operable space. An element of hpianMs be importaht in doing 

research. Most of the management people had this. 

2. We 80*6 apt to get in a rut, Two or three good results in a 
row will convince most of us that we have a good point. Sometimes we 
are so convinced that we refuse to look at o%er points. Un!fortunately, 
a large positive error can occur two or three times in a ro4. Tl:^s " 
leads to difficulty. Once the researcher becomes convinced ^that the 
best value for a certain variable is in a certain range, he may do a 
tremendous amount of resparcih^ before changing his mind. On^ team ran 
three tests and concluded that the best level on a variable ^Vas 65 * 

They then ran 2k tests without looking at any other level Oh that vari- 
able# The best level was actually at l8l We are apt to get a notion 
and stick to it through thick or thin# :I “ 

3# We don't pay enough attention to the error# This leads to^^ 
frustration. We are trying to attribate every change in yield response 
to a change we made in one or more of tha We dori' t have a 

good '’feel". '.for ..what;..er]^or .,.can^^ do,,.:^to_o\^_r^ . ji. 

h. Some of us have a linear ..pomplex. Intuitively we think of all 
effects as straight line relationships. This can lead tP mistakes. 

5 . We don’t always eliminate the unimportant variables. In the 
first model of the AlfJOHOL PLANT, variable D had no effect the sys- 
tem. Many of the researchers never discovered this. JElimibation of 
the unimportant variables simplifies the problem. 

6. We don’t know when to ctuit. Some research teanis failed to 
stop and consider periodically whether they were really getting any- 
where. Some sort pf running estimate of how we are dping soems to be 
essential to a good strategy. The administrators in general had this 
ability. They q^uit research early if they discovefed that they were 
not getting anywhere. 

VI. EbP^ENTS^ 1^ IN A ’’BEST" STRATEGY 

The work reported in this paper shows how we dp our re^esurch work. 
It points up some of the ml stakes, w^ are apt to make but do^s not reach 
a final conclusion as to the best research strategy. The designed ex- 
periment strategy is better than the one -at -a -time strategy i Howevef, 
experience and judgment are important. The use. of a designed experiment 
alone does not produce good res^llts. Judgment is needed inilmakiiig de- 
cisions, The designed experiment is probably not the best strategy. 
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It is simply a better strategy than the orthodox one-variable-at-a-time 
vay of doing en^irical research. 

Observation of the various strategies used has pointed up some 
elements which may be part of the "best" strategy. 

1. A best strategy will have some way of making use of informa- 
tion as it is collected. It does not seem sensible to wait until a 
large block of information is collected before changing our strategy or 
before the ini*03:mation can be used. In the best strategy^ decisions 
will be made more frequently than they normally are when using a stand- 
ard statistical design. The one-test-at-a-time approach is an unsuc- 
cessful attempt to do this. 

2. The best strategy will involve a scheme, whereby, the strategy 
is developed as information is obtained, in short, the master strategy 
will involve changing the immediate strategy to fit the problem. 

Changes in the immediate strategy will be made as the nature of the 
problem becomes more evident. The immediate strategy will then always 
be the best one for the problem as it unfolds. 

3* The best strategy will involve different levels of screening. 
There will be some gross type of examination first which is made quickly 
and cheaply followed by a more refined study on a smaller part of oper- 
ating space and this in turn will be followed by a still more intensive 
study on a smaller part of operating space. Unimportant variables will 
be dropped early. 

4. The best reseetrch strategy must include some way of defining 
operating space. In most real problems this is difficult. In the 
model problems used here, of course, operating space was defined auto- 
matically by the limits on the dials, there were no islands or inlets 
in operating space. However, in real problems the operating range on 
each variable may depend on where the other variables are set. 

The best strategy will Incorporate a boldness which will make 
it willing to look into the unknown, so that all parts of operating 
space are explored. 

6. Decisions will be made with a calculated risk. The risk taken 
will probably change as the work progresses. Possibly more risk will 
be taken in the early stages of the problem than in the final stages* 

7« The best strategy will include a rule for deciding when to 
quit research. It will show us how to know when further research is 
unlikely to pay off. 

VII. SIMIARY 

Some research on enpirical research strategies has been carried 
out using electrical analogs of research problems* This work was 
limited largely to learning how people do enpirical research work and 
to comparing the success of those people who use the one -test -at -a -time 
approach with those using some type of statistically designed experi- 
ment. The statistically designed experiment is better than the one- 
variable -at -a-time strategy* The work has shown some of the mistakes 
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ve €Lre apt to make in doing empirical research and has suggested some 
of the elements needed in a test strategy. The help of mathematicians 
in developing a best strategy is sought. A best strategy fpir doing 
empirical research work would be of value in making industrial research 
more useful to society. 
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TABLE I 


FIRST ALCOHOL PLABT 

(Simple Relationships - Unknown Large Error* ) 


Game 

Ranking 

Strategy Used 

Number 

of 

Tests 

Gain in 
Yield, ^ 

Profit over 
Competitive 
Research 

- 

Maximum Possible Gain 


18.2 

- 

1 

One variable at a time, dupli- 
cated first three tests. 

Luck? I&iov when to t^uit. 

10 

16.6 

$7,100,000 

2 

One at a time, large steps 
( 10 - 90 )* Didn't cover all 
variables* Luck? Know when 
to quit* 

9 

15.6 

6,720,000 

3 

1/4 replicate of 2 *^ factorial 
(35-65) then small adjustments* 

19 

17.2 

6 , 420,000 

4 

Random numbers, then small 
adjustments* 

18 

14.2 

4 , 940,000 

5 

Randomize interaction vectors* 

17 

13.9 

4,910,000 

6 

One at a time, small steps at 
first* Regression analysis. 

18 

13.0 

4,340,000 

7 

Box-Wilson starting with 1/4 
replicate of 2 ^ factorial 

(35-65). 

33 

16.3 

4,190,000 

8 

Luck, Know when to quit. 

3 

8.0 

3 , 640,000 

9 

One variable at a time, repli- 
cate to get estimate of error. 

.18 

10.6 

3 , 140,000 

10 

1/4 replicate of 2 ^ factorial 
( 40 - 60 ), 

10 

7.0 

2,300,000 

11 

One test at a time. Know when 
to quit. 

6 

4.8 

1,680,000 

12 

1/4 replicate of 2 ^ factorial 
( 40 - 60 ). 

11 

5.8 

1,580,000 

13 

One at a time ( 25 - 75 )* Know" 
when to quit. 

11 

5.7 

1,530,000 

Ik 

1/4 replicate of 2 ^ factorial 

(35-65). 

13 

5-7 

1,290,000 

15 

One at a time* Became frustrated, I8 

6.8 

1 , 240,000 
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TABUS I (Cont^d, ) 
FIRST AIjCQHQL PIMT 


Game 

RanHing 

Strategy Used 

of 

Tests 

Gain in ; 
Yield, i 

Competitive 

Research 

16 

One at a time. Became frus- 
trated. 

39 

„u- 5 , 

$1,070,600 

17 

One at a time. Made many 
small changes . 

18 

6.0 

840,000 

oB 

One at a time. Became frus- 
trated. 

19 

6.2 

820,000 

19 

One at a time. Frustrated 
at end. 

23 

5.7 -j 

90,000 

20 

c 

1/4 replicate of 2 factorial. 
Small steps. (5O-65) 

17 

4.1 p 

10,000 

21 

One at a time. Frustrated at 
end. 

25 . 


-500,000 

22 

Full 2 ^ factorial design ( 20 - 80 ). 
Data not analyzed. 

, k3 

8.5 : 

-910,000 

23 

1/4 replicate of 2 ^ factorial. 

23 

3.1 

- 1 , 210,000 


Stoll steps (50-60). Then one 
at a time. Frustrated. 
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TABI£ II -1 


SECOHD ALCOHOL PLAST 


(ifore Complex BelationsMps - Error Stoialler and lOiomi. ) 


Gome 

RanKlog 

Strategy Used 

Number 

of 

Tests 

Gain In 
Yield, i 

Profit over 
Competitive 
Research 

. 

Maximum Possible Gain 

- 

16.5 


1 

Fractional replicates of 2 ^ 
factorial* 

20 

15.9 

$5,550,000 

2 

l /9 replicate of 3 ^ factorial. 

31 

16.3 

4,430,000 

3 

Eliminate operating space 
using random numbers. 

9 

8.5 

3,170,000 

4 

One variable at a time, big 
steps ( 10 - 80 ) Luck? 

9 

8.5 

3,170,000 

5 

1/4 replicate of 2 ^ factorial, 
big steps ( 20 - 75 )* 

15 

9.1 

2,750,000 

6 

Randomize interaction vectors. 

18 

9.1 

2,390,000 

7 

l /4 replicate of 2 ^ factorial 
repeated at different levels 
(20-60 and 40 - 80 ). 

20 

9.5 

2,350,000 

8 

Series of fractional 2 ^ fac- 
torials. 

33 

12.0 

2 , 040,000 

9 

Small designed experiments. 

27 

7.8 

660,000 

10 

Box -Wilson Technique. 

34 

9.0 

420,000 

11 

Common sense, intuition, one 
variable at a time. 

33 

8.2 

140,000 

12 

l /4 replicate of 2 ^ factorial 
repeated. 

15 

3.5 

-50,000 

13 

l /4 replicate of 2 ^ factorial. 

9 

2.0 

-80,000 

14 

One at a time, big steps 

( 15 - 75 ). 

21 

4.5 

-270,000 

15 

One at a time, big steps 
(20-80). 

13 

5.0 

-500,000 

l 6 

Factorial designed experiments 
(20-70). 

46 

9.8 

-620,000 

1 ? 

Small steps, one at a time 
( 45 - 60 ). 

8 

0 

-960,000 

18 

One at a time. 

8 

0 

-960,000 

19 

One at a time* 

8 

0 

-960,000 

20 

One at a time, big steps 
( 10 - 90 ). 

21 

3.0 

- 1 , 020,000 

21 

One at a time. ( 40 - 70 ) 

9 

0 

-1,080,000 
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TABLK II -2 


Game 

RanMng 

Strategy Used 

Number 

of 

Tests 

Gain in 
yield, i 

Profit over 
Competitive 
Research 

22 

One at a time. (25 -TO) 

9 

0 

-1,060,000 

23 

One at a time. (30-70) 

19 

1.6 

-1,480,000 

&k 

One at a time. (50-70) 

14 

0 

-1,680,000 

25 

Two at a time. (25-70) 

14 

0 

-1,680,000 

26 

X/k replicate 2^ factorial 
(35-65). Then Box-Wilson. 

25 

2.4 

-1,800,000 

27 

One at a time. 

15 

0 

-1,800,000 

28 

One test at a time, big 
steps (5-65 )• 

23 

1.0 

-2,260,000 

29 

One test at a time. (25-75) 

22 

0 

-2,640,000 

30 

1/4 replicate of 2^ factorial 
(35-65), plus other tests. 

27 

1.1 

-2,690,000 

31 

Latin Square type of design 
(5 x 5)* Small steps (40-60). 

28 

1.0 

-2,800,000 

32 

One at a time (25-70). 

44 

1.1 

-4,730,000 
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TABLE III 


SNAFU UNIT 

(With Two Discrete Variables - Small Error Known, ) 
(Each Team Was Allowed kO Tests. ) 


5^ of 


Game 

Ranking 

Strategy Used 

Yield 

Improvement 

Possible 

Gain 

- 

Maximum Possible Gain 


100 

1 

27 tests in form of I/27 frac- 
tion of 3^ factorial, then 

1/2 replicate of 2^ factorial 
on 4 continuous variables. 

12.7^6 

91 

s 

Fractional replicates of 2*^ 
factorial experiments. 


82 

3 

One test at a time. 

10 . yf, 

74 

k 

One test at a time 

Q.ef, 

62 

5 

One at a time or several at 
a time. 


45 

6 

One at a time. 

3 .Tf> 

26 
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STATISTICAL jv^THapS IN SORTING OPERATIONS 

VJilliam C# Visaing 
Eli Lilly and Company 

Wherever it is possible, we attempt to prevent the 
occurrence of defective pieces# In some processed it is 
only economically feasible to keep defectives to a minimum# 
We resort to sorting in these operations to furth|r reduc^^^^^^ 
the defectives within the limits of our outgoing quality 
levels. 

The purpose of this paper is to explain how Rampling 
and charts can be applied effectively to maintain 'quality 
and reduce labor and material costs in sorting bpfratiohs# 
There are additional benefits. Three different sorting 
operations will be explained to show the applicatibn of 
techniques and specific benefits derived in each program# 

I. 

Soft Gelatin Capsules 

In the gelseal manufacturing department the ;()roduct 
was given a 100 percent sort after the drying opei|ation, 
for the purpose of removing the defective gelseals (soft 
gelatin capsules). The most prominent defective was the 
leaker. This was a capsule that lost cottonseed oil during 
the drying operation. Very often oil spots were left on the 
absorbent paper used on the drying trays. This made it 
relatively easy to see the defective and remove il# Others 
have seeped oil only slightly and could hot be seen. These 
could become a serious problem after extended periods of 
storage# 

' ■ ■ 

Our pilot plant developed a method to detect leaker s 
more readily. Since some of the vitamins are fluorescent, 
they can be seen easily under a harmless ultra-viplet light. 
It became relatively easy to spot the defective piece and 
remove it. 

Other defectives of less intensity were malformed 
capsules, specks, bubbles, and partial fills# Thp trays 
were examined very carefully for all these defectives and 
then emptied into a cardboard box# These boxes (containing 
approximately 15,000) were examined by an inspectpr for the 
’^pharmaceutical elegance't of the product# 

These questions arose; What is our present quality 

level? Is it necessary to do so much sorting? Would it be 

possible to remove only the leakers or obvious defectives by 
a quick sort and then, by the use of a sample, determine 
whether further sorting is necessary? 

Working very closely with the development and pro- 
duction divisions , we established a set of standai*ds that 
were acceptable to the control division • Some pf,,,the ^ ^ 

production was sampled for approximately a month, after the 


19 



regular sorting operation, to determine the existing quality 
level. Using this as a guide, an acceptable quality level 
was set for the process. 

We agreed to compare the quality of lots of material 
after conventional sorting (a detailed examination of each 
tray) with a new method (a quick inspection of each tray to 
remove obvious defectives). It was determined that if we 
found and removed seven (7) or less obvious or critical 
defectives on a tray after a quick inspection this tray 
would be emptied into a box with no further sorting. If 
eight (8) or more were found and removed, that tray was 
given a detailed inspection for all defectives. At the end 
of this process a sample of three hundred (300) was removed 
from each box and examined carefully for all defectives. 

The plan was to accept zero (O) critical defectives and 
seven (7) or less obvious (minor) defectives. Resorting was 
performed on those that did not pass. The results of this 
experiment were as follows: 



Total 

Defect. 

Defect. 

Removed 

Defect. 

Remain. 

Total 

Boxes 


Before 

In 

After 

Boxes 

100? 


Sorting 

Sorting 

Sorting 


Sorted 

S Lots 

Old Method 

1.09^ 


.51? 

221 

221 

11 Lots 

Hew Method 

1.08^ 

.42? 

.66? 

304 

12 

The AQL 

of the lots 

sorted by 

the new 

method was 


approximately the same as the AQL of the conventionally 
sorted lots. Intensive sorting was devoted to those Hct- 
ions that needed it, while a quick sort was all that was 
necessary for the major portion of the eleven lots. 

This program was adopted essentially as described 
above. The methods department determined that there was a 
monetary savings of approximately $44»000 annually. The 
program was established on a trial basis and eventually 
became a part of the regular procedure for this department. 

Where the sample indicated it vels necessary to sort, 
very often one to two types of defectives were predominant. 
The sorter could concentrate her efforts on these and thus 
do a more effective job. Manufacturing and development 
personnel were very quick to note high amounts of certain 
types of scag (defective) and make process improvements. 
This was an additional benefit in the program. 

After approximately a year of operation, the number of 
boxes being 100 percent sorted dropped from 7 percent to 
less than 1 percent. This was attributed to further im- 
provements in the quality by the pilot plant and production 
departments. We eventually progressed to reduced sampling 
where one out of every four boxes was sampled. 
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The overall benefits of thie program have been: 

!• Uniform Quality Level 

2# Increased Yield 

3m Reduced Labor Costs 

4* Improved Sorting Techniques 

II* 

Timed Disintegrating TabIgjLa.., ; ^ _ 

There is a definite need to establish s standards 

on a product. First of all, it defines a defective and also 
an acceptable piece. It assists in training new porters, 
serves as a review for experienced sorters and helps to keep 
the number of good pieces removed as defective to iia minimum. 
This last point is one of the human errors in sorting; that 
is, removing good pieces as defective. Sorting can be made 
more effective when there is concentration on a particular 
defective or group of defectives with less emphasis on the 
minor categories. 

This was important in the sorting operation in the 
process of manufacturing timed disintegrating tablets. 
Tablets pass before two sorters. The first sorter 
one side of the tablets and removes def ectiye pie posv T^^ 
tablets are automatically inverted and another sorter ob- 
serves the other side of the tablets. One of the^ firsts 

analyses of this operation showed there were 35 to 50 
percent acceptable pieces in the scag. Obviously, standards 
were a must. 

The categories on standards were as follows: 

Critical - Any type of defective that impairs 
the value of the tablets (broken, 
double tablets). 

- An obvious defective that renders: the 
tablet unsightly, but does not affect 
the therapeutic properties of the:, 
tablet (large bubbles, large scratches). 

- A defective not de^ihed as major or 
critical (small scratches). 

The standards were explained to the sorters. They were 
asked to concentrate their efforts on the major and critical 
categories x^ith less attention to the minor or border line 
tablets. The results were that acceptable tablets removed 
as defective dropped from 35 to 50 percent to approximately 
6 percent. The resultant monetary savings were substantial. 
By concentrating on the critical and majors, there was also 
an improvement in the outgoing quality level. 

Two charts were adapted to the process. One was to 
control the percent of good removed as defective.!: We es- 
tablished an arbitrary upper limit of 10 percent! good 


Ma ,1 or 


Minor 
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tablets in the product removed as defective scag* Samples 
of three hundred (300) were taken from approximately every 
fifth lot by the supervisor and analyzed for the percent 
good in the soag* These values were plotted on a chart* 

This became a very useful tool in training new sorters# 

The other chart was a »*c'' chart on scag removed in 
sorting* The average scag of five (5) consecutive lots was 
plotted on the chart* C varied from #10 to #30 of one per- 
cent* The upper limit was used to warn the process oper- 
ators that they were producing 'enseals » at a high defective 
rate » 


Effective control on the quality of the sorted product 
was maintained by an inspection department# 

'enseals* (Timed Disintegrating Tablets, Lilly) 

III# 

Sorting of Filled Capsules 

The sorting is combined with dusting and polishing 
pulvules (filled capsules)# As the operators dust and 
polish the product on large tables, they stop intermittently 
to examine the pulvules for defectives* The acceptable 
product is put into drums, checked by inspection for 
"pharmaceutical elegance" and then sent to the finishing 
department# 

Good quality is important in subsequent operations for 
two major reasons* 

1# To keep down-time on automatic filling equipment 
to a minimum# 

2# To reduce rpwork of the product after packaging* 

Critical defectives, such as separated capsules, made 
it necessary to stop and clean equipment frequently* Oper- 
ators took off bottles that contained visible defectives as 
they passed before them on the finishing belt# Both factors 
increased the cost# 

What should be the outgoing quality level? V/hat is it 
now? There were no numerical answers to these questions# 
Standards of "pass this or better" nature were established# 
Then sampling was applied to determine the AQL* 

The pulvules fell into two groups; old process and 
new process, and therefore two quality levels* (The company 
was in the process of. shifting all capsule manufacturing to 
a new plant*) Quality levels were 3 percent and 1*5 percent 
respective with normal sorting operations* These values 
were incorporated into acceptance sampling plans* 

The procedure, very briefly, is as follows: 
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Two production inspectors sample sorted drums: of 
pulvules# Those found to be unacceptable by the sample are 
returned for resorting on the sorter »s own time o |the sorter 
is informed of the type of defectives most prominent in the 
sample* This provides for more selective resorting and im- 
proved performance* 

The statistical inspection department maintained charts 
for a time in the department to show the AQL of each lot In 
the two groups* 

Sampling is applied also to the scag* Results on the 
amount of good in the scag are reported to production 
supervision* The statistical inspection department samples 
two or three sections of scag per week as an audit of the 
process* 

The results of the program have helped reduc^- reworks 
and down time, and also Improved the outgoing quality* 

Supervision became aware of certain types of ^defectives 
made at the filling machine* They organized for corrective 
action* A program was initiated to periodically inspect 
filling rings for excessive surface wear. Worn rings were 
replaced* This further helped to reduce scag and Improve 
the outgoing quality* 

Summary 

We strive for perfection in detailing but have come to 
recognize there are definite limits in these operations* 

You can do much to assist the sorter to improve the oper- 
ation; such as, provide adequate equipment and light, define 
defectives through standards, determine process capabili- 
ties, provide for indoctrination of your program ahd follow 
up with examinations of the product removed as defectives* 

These steps can lead to labor and material sayings, 
but the methods can often illustrate where further' in 
provements can be made in the process* Therein lies one of 
the basic concepts of quality control; building quality into 
the product at the machine* As the types of defectives are 
reduced to a minimum, sorting can be minimized as Wll as 
made to be more effective* These will help attain' the goal 
of a higher quality product at minimum cost* 
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STATISTICAL STUDIES OF ROSIN SIZING EVALUATION VARIABPS: 

IV. THE DETERMINATION OF MINIMUM-COST TESTING PROCEraJRES 
W.M. vJocxiing 

formerly American Cyanamid Co. 5 
now Revlon, Inc, 

Introduction 

In a laboratory conducting sizing evaluation work, it quite 
often becomes desirable to alter the sheetmaking and related: testing 
procedures in the interests of economy, efficiency or reliability. So 
many factors go to make up the sum total of a given evaluation, however, 
that it is often difficult to develop a system by which comparisons 
between procedures may be made without resorting to guesswork as at 
least a partial basis for the decisions that must be reached. 

The methods described in this presentation will allow compari- 
son of two sets of evaluation conditions, such as the use of different 
sheet machines, different refining methods, etc,, as well as the deter- 
mination of the proper number. of tests and sheets to use in a given pro- 
cedure. Since results may be expressed as costs, either in dollars or 
in time consumed, they are readily presentable to persons who may not be 
familiar with the statistical techniques involved. The limitations on 
the use of such a system as this, of course, lie in the fact! that 
results apply only to the predicated conditions; therefore, if alter- 
native procedures are foreseeable, they must be included in :the experi- 
mental design. Provided that this can be done, the dec! si oh as to the 
best and most economical procedure becomes simply a matter bif comparing 
costs or time consumed. 

The procedures to be described have been adapted to other 
systems in addition to rosin size evaluation work, and one of the pur- 
poses of this paper is to suggest such generalizations. It should 
therefore be borne in mind that although the examples selected below 
were based on rosin size work, they are very definitely not limited to 
this field. 

The remainder of this paper will be presented as a report on 
a project carried out at Cyenamid, which will illustrate theee computa- 
tional procedures. 

Experimental Design and Procedure 

The questions asked at the beginning of this experiment weres 

1 ) In evaluating rosin sizes, how many handsheetS should be 
made, and how many sizing tests should be made per sheet, 
for lowest cost operation (cost per sample of rosin size 
tested)?^ 

2) Does the use of additional refining following beating, 
using the Morden Laboratory Refiner, reduce or increase 
the cost of sizing evaluation? 

The information presented below represents a portion of a 
broader experiment, in which a number of additional variables including 

^It was believed, and subsequently shown, that the figures obtained 
would differ with different types of sizing tests. 
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degree of beating, type of sheet machine used and other factors were in- 
cluded in order to measure their effect upon the cost of evaluation of 
a size. 

To answer the questions proposed, the following experiments 
were planned and carried out. All laboratory procedures referred to 
below have been described in a previous publication (2) : 

Two rosin sizes were used, adding 1$ size solids and l-g^ alum 
(dry basis) to the pulp. The experimental design was in the form of a 
small factorial: 


where, Mq = Pulp not "Mordened” 

-Pulp "Mordened” for 2 minutes 
Zq = Regular rosin size 
= Fortified rosin size 
Aq = Sheets tested on felt side* 

A]_ rr Sheets tested on wire side* 

The sheetraaking work of this experiment V7as done in a single 
day, so that no question existed regarding the effect of day-to-day 
variations in sheetmaking conditions upon the data or their precision. 

The handsheets made were given the following sizing tests: 

Iiik Penetration Test : These were so-called "opticar* or 
modified BKI tests, using an instrument designed at Stamford similar to 
the regular BKY Inlc test, but providing for elimination of the effects 
of heat from the light source upon the measurements. 

Lactic Acid ; Standard Penescope test at 100 ^F. 

Total Water Immersion : "Water Absorption" test, carried out 
by immersing weighed portions of sheets in water at 70 for 15 
minutes, blotting, reweighing and expressing results as per cent gain in 
weight. 

Basis V/eight : These data were obtained as a check upon the 
uniformity of the sheet batches made, and were done in the conventional 
manner . 


rii^Tn • 

MqZ^Ai 




Wo 


The testing schedules used were as follows: 

Ink Tests ; 

Wire Side : Two tests on each of five light sheets**, using 
sheet Nos, 5, 7, 9, 11 out of the serially-numbered total of 15 
sheets made. 

Felt Side ; Same, on sheet Nos. 2, 4, 6, 8, and 10, 

Total , 20 tests per set. 

* At the time this work was done, it was known that differences in pre- 
cision between wire and felt test data existed in some cases 
(cf. Ref. 1 and 2). 

**The,sets of handsheets consisted of 15 light sheets (50 lb.) and 
eight heavy sheets (200 lb.), 25 x 40/500 basis. 
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Lactic Acid Tests ; 

Wire Side ; Two tests on each of two heavy sheets, -ilos* 1 and 
5, out of the total of eight sheets made* 

Felt Side ; Same, using sheets 3 and 7* 

Total . Eight tests per set. 

Water Absorption Tests : 

Two tests on each of four heavy sheets. Nos. 2, 4, '6 and S* 
Total . Eight tests per set. 

Basis Weight ; 

Average figure obtained by weighing groups of sheets from 

each set. 

Summary of Data Obtained 

The basis weight dsta obtained for each set are shown in 
Table I . The individual test data are given in Tables 11, if I and IV 
for Ink, Lactic Acid and Water Absorption tests respectively^ 

Table I 

Summary of Basis Weight Data 

Basis Wt. . Lb. . ^5 x 40/5CX) 
Explanation Light Heavy 

Mordenedj regular size 49.3 ; , 209.0 

Mordenedj fortified size ^.7 

Not Mordened; regular size 4B.8 205.5 

Not Mordened j fortified size 4S .2 " 201. 0 


Computation of Number of Tests 
Per Sheet and Total Number of Tests 

The purpose of the following calculations was t<5 determine the 
net standard deviation of a single item when samples are examined in 
various combinations of tests betv/een and within sheets. This is done 

by analyzing, then recombining the sheet-to-sheet and within-sheet 

estimates of error. The resulting values of standard deviation are then 
used in conjimction with Sillitto's tables (3) as described previously 
(l), but this time as separate determinations of the number of tests 
required, using various numbers of tests per sheet. 

It will be seen that if the within-sheets error is 'low and the 
between-sheets error is high, it will be advantageous, in tej^s of the 
total number of tests needed, to make few tests per sheet and to use a 
relatively large number of sheets. ‘ If, on the other hand, the within-- 
sheets error is high and the between-sheets error is low, fewer sheets 
and more tests per sheet \n,ll be necessary in order to obtain' the 
smallest number of tevsts. To illustrate the calculations involved, the 
ink test data of Table II will be used as an example:’ 

• H 

The data were classified into small groups, each representing 
a single level of the variables concerned. -Assuming that the; effect of 
Mordening upon precision is to be determined, but that of wire ve^^^ 
felt and that of different sizes is not^, the classification^ would be 

’^hese had been measured in previous experiments. 


Experimental 

Code 


MlZo 

MqZi 
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Ink Penetration Test Data 
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ic Acid^ Test Data 



Wot Mordened, Fbrtifled Size} MqZi I 32*7 32.1 1 35.1 32.4 35.1 ^ 34*5 f 33o6 [ 34o3 























the following: 


Mordened 

M-Zpj Wire 
irz!: Wire 
M^z;!: Felt 
Felt 

An analysis of variance was carried out upon each small group, 
bearing in mind that ink . tests . were done at the rate of two per sheet, 
using five sheets for the felt and five for the wire side tests. The 
degrees of freedom (DF) were summarized as follows; (Table V) 

Table V 

Analysis of Variance 
(Ej^mple — Wire) 

Source of variation DF 

Between sheets (5 sheets) 4 

Within sheets (l DF/sheet. 5 sheets) 5 

9 

Sums of squares were calculated conventionally to outline an 
analysis of variance as shown for each of the classifications used. 

The following formulas were used in this particular work, and represent 
simplified computations, since only two tests per sheet were used; * 

1) ^ CEX)‘ 

3 10 

2) ss^ ^ 2(X;^ - Xg)^ 

2 

3) SS. ^,^2 Qpc)^ 

10 

where X -- An Individual measurement 

Xn and X 2 = A pair of measurements on the same sheet 
SS-j^ Sum of squares for "between sheets" 

SS^z= Sum of squares for "within sheets" 

SS^ = Total sum of squares 

The use of the SS^ computations is a check. upon the calculations of the 
other two. 


Not Mordened 


MqZo Wire 
M^z!: Wire 

Vo 

MqZ^ Felt 


The analyses of variance were tabulated and the sums of 
squares added : (pooled) with the revsults shown in Table VI (the 
"unmordened" data were handled in the srme way). 


* Reference ( 4 ) gives generalized formulas for these operations. 
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Table VI 



Pooled Sums of Sauares 
(stock Mordened) 



Set 


5i 




M^Zq Wire 

3815 

638 



4453 

4 

5:: 

M^Zq Felt 

1190 

800 

1990 

4 

5: 

^1^1 

360 

950 

1310 

4 

5 

Felt 

300 

963 

1263 

4 

i. 


5665 

3351 

9016 

16 

20, 


The pooled values of SS^ and SS^ were divided by their 
respective degrees of freedom, to obtain mean square values; for between 
and within sheets and ^^Sy) : 

1) SS^ 5665 354 

^ ...-•-i 

DF^ 16 

2) MS^ SS^ 3351 168 

“dF„ 20 

now, by the law of additivity of variances, 

<5;j^ * (EMS)^ 

where EM5 « “expected mean square “ 

k * actual number of tes^ sheet ( Z) 

therefore, (substituting): 

2d^2^ (EMS)„ 

<y^2 _ (E>B)^- (EME)^ 

2 

and, in terms of the estimated values, of ^ (which are S^), and EMS 
(which are r4S) : 

1 ) ^ ^ 

= 2 
2) ^ (HS)^ 

Substituting the values found for (MS)]^ and (MS)y, 

^ - (MS)^ 354 - 168 93 
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Sw 2 = (MS)^ = 168 

NOTE; Since the within sheets MS, imist obviously always be 

equal to or smaller than that for betweeA sheets, (145)13^ which includes 
it, we must concltide that (MS)'J 3 and are both equal to zero whenever 
it is found experimentally that (MS)y is greater than (MS)b* This 
situation, of course, did not exist in this particular case, and it is 
obvious that there is considerable sheet-to -sheet error in addition to 
the within sheet errors; i.e., (MS)'b is greater than (MS)y^ 

Variances and standard deviations to be used in computa- 
tions of the total number of tests by entering Sillitto’s tables were 
now calculated by means of a relationship derived as follows: 

Let A = number of sheets tested 

B = nmber of tests per sheet 

= variance of means 

Now, by additivity of variances, 

ABS^ = Sy + BS-b (AB = total number of tests) 

By definition, 

S» = 

^ AB 

Therefore, substituting, 

S2 = + BS§ 

Using this relationship, several values of B were selected 
arbitrarily and calculated for each: 

Recall that = 93 and = 168. 

= 1, 2, 3 and 4 * tests per sheet 

The calculated results are shown on Table VII: 

Table VII 

Calculated Overall Standard Deviations 
For "various Nmbers of Tests/SheeF " 

= 1^ + 93B) 

B — 2 3 

S2 = 261 354 447 540 

S=yg^ 16.16 18,81 21.14 23.24 

^ 4 was the maximum usable value because of the size of the 
British handsheets« 
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The calculated values of S were usod to enter SililttpV^ 
tables (3) as described in a previous publication (1), using selected 
values of CD For this work, the and^ errors chosen were:: 5 and ID^ 
respectively* To facilitate this portion of the work, plots of 
Sillitto*s tables were used* Reproductions of these have been published 
previously (l) . It should be noted that Sillittp Ve^^^^^^^^ ^^re based 
upon the t-test, although they have the additional advantage of allowing 
an estiinate of error* For this reason, values for the number of tests 
required will be low for a given confidence level, "idien it is intended 
to compare pairs of mews selected from groups containing moire than two 
means* For such work, a more realistic comparison of means Is furnished 
by the Tukey method* However, for the purpose of this investigation, 
which was to obtain a relative evaluation of ^n^ 
sequently of costs, the absolute values were not necessary. 

Using the method just described, plots were prepared, showing 
the number of sheets and tests needed for various number of ^tests per 
sheet and desired critical differences* These are shown for, the three 
tests, ink, lactic, and water, for each of the two conditions, Mordened 
and hot Mordened, in Figures 1, 2 and 3* Intermediate curves for 2 and 
3 tests per sheet are omitted for clarity * 

■ ■ 

It will be noted that the total number of sheets 'and tests, 
and therefore the total cost, of an evaluation, goes up very ‘sharply as 
the desired CD is reduced in arithmetic progression* This ;^ints up the 
necessity of carrying out evaluations at the highest CD value which can 
be used, consistent with the type of information desired* 

The preceding data were next applied to calculations of the 
relative costs per size sample evaluated, in order to make possible a 
decision as to the optimum number of tests and sheets^ f^^^ 
laboratory work when these three types of tests were used to evaluate 
a single size* 

CALCULATIONS OF VALUATION COSTS 

Computations of the number of sheets aiid . tests which could 
be used to evaluate a given size, as has been iliustrated a|pYe, does 
not complete the picture. For most economical. operation, ii remains 
to choose the combinatipn of sheets and ^ the lowest 

cost, and this, of course, is dependent upon the relative expense of 
sheetmaking and testing* The necessary calculations to allqw such 
decisions are illustrated belpw* 

In performing the following calculations, the assumption was 
made that, with one exception, the cost of materials used ip sizing 

evaluations was negligible relative to the cost of , timP cpr^imied* The 

times used for each operation shown were necessarily estimated average 
values, but as much care as possible was taken to obtain them. The es- 
timated times were .converted to dollw yal^^ basis pf arbitrar- 

ily-selected overhead cost figures for sheet testing and sheetmaking 
operations • 


CD = Critical Difference; i.e., least significant difference between 
two means. 
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TOTAL NUMBER OF SHEETS REQUIRED PER SAMPLE EVALUATED 
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All resTolts were expressed finally in terms of relative 
dollar costs of a single rosin size, using ink, water and lactic tests. 
The method illustrated m be erfcrapolated by analogy to any set of 
local sheetmaking and testing overhead costs, and any testing schedule. 

At Cyanamid, using the present laboratory procedures, the 
cost of evaluating a rosin size sample consists primarily of ' the follow- 
ing major components: costs of beating, Morden refining, blotters, 
handsheet making and testing. These are analyzed below using the 
assumed overhead costs; 

a) Beating : A regular beater run \4-th, the ”5 pound” Valley beater at 
CyAnamid contains approximately three thousand grams of pi^p (dry 
basis) ♦ Three such runs may be made one man in a day. Therefor^ 
nine thousand grams of pulp are available after a day Vs work. 
Assuming an overhead charge of |6.00 per man-hour, this amounts to 

a cost of ^t4S.OO per nine thousand grams of pulp, exclusive of 
materials . 

"Light” British handsheets w about 1.2 grams each. 
Therefore, 9000/1.2 = 7500 light sheets per day^s output o The cost 
per sheet is therefore §4^.00 per 7500 = $0.006 per light sheet. 
Similarly, "heavy” British sheets weigh about 5.0 grams each. I^r- 
forming a similar calculation, f 

i.OO - $0,027 per heavy sheet. 

9000^ 

b) Morden Refining ; After sizing, the stock is refined further by 
treatment in the laboratory Morden refiner (2). About five, mi^n^ 
of total working time are required of a man to "Morden” .a, batch , of , 
stock from which fifteen light (1.2 gram) and eight heaiiy (5.0 gram) 
sheets will be made, allowing for discarded test sheets ^ v^is^^ re 
requires 95 grams of pulp (dry basis) • 

Of the 95 grams of pulp Mordened, 5^ grams are used for 
actual sheets to be tested (15 x 1.2 + 8 x 5.0). Mordehing time is 
therefore 5 minutes per 58 grams = 0.0862 minutes per of pulp 
Mordened. At the assumed overhead rate of $6.00 per mah-hour for 
sheetinaking, the cost becomes: 

0.0862 X min, x $6.00 = $0.00862 per gram. Therefore, Mordening 
gra. . to Min. 

costs are: 

LIfM Sheets: 1.2 x ^ 

sheet gm. 

Heavy Sheets ; 5.0 cti. x $0.00862 = $0.043/sheet 

sheet .. 

c) Sheetmaking : The sheetmaking for this experiment required one man- 
day for foTor sets, including preparation, calculations and note,, 
taking. This is. equivalent to two hours; per set of she.ets. It was 

observed that ; about, the same amount of ^time .was consume^^ in ,mald^^ 

the eight heavy sheets as. the fifteen light sheets in eac&^sel. 
Therefore : 
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Light Sheets; 

60 min. 

X §6.00 = 

§0, 400/light sheet 


15 sheets 

60 min. 


Heavy Sheets; 

60 min. 

X §6.00 = 

§0.750/heavy sheet 


8 sheets 

60 min. 



Blotters : The only significant material cost in the evaluation 
work appeared to be that of blotters. At the time this work was 
done, 8” x 8'* blotters, pre-cut, were available at §6.04/thousand. 
Every British sheet required three new blotters in its preparation; 
therefore ; 

Blotter Cost = .00604 x 3 = $0.018/sheet 

blotter 

Testi3ig ; A study of the testing work gave the following estimates 

of testing time; 

In3c Tests ; 50/man-day 
Lactic Tests : 100 /man-day 
Water Tests ; 150/man-day 

Assuming an overhead charge of >00 per man-hour for testing or 
§5.00/60 = §0. 083/minute; 

Ink Tests; 8 hr. x 60 min , x §0.083 — §0.800/test 

50 tests hour min. 

Lactic Tests; 8 hr. x 60 min , x §0.083 = §0.400/test 

100 tests hour min. 

Water Tests; 8 hr. x 60 min , x §0.083 = §0. 266/test 

150 tests hour min. 

f) Summary of Costs; The foregoing calculations are summarized, for 
convenience, in Table VIII. 

Table VIII 

Costs and Ti m e Consumption for Rosin Size 
Evaluation Work-Sumary 
( British Sheetmalcing Equiment ) 

Assumed Pulping, Kordening and Sheetmaking overhead = §6. 00 /man-hour 
Assumed Testing overhead = §5,C0/man-hour 


Operation 


Cost. Dollar s Time. Minutes 

per per 

light sheet heavy sheet l ight sheet hvy. £ 


(a) Beating §0.006 

(b) Mordening 0.010 

(c) Sheetmaking O.400 

.d) Blotters (material cost) 0.018 


Ink, per test §0.800 
Lactic, per test 0.400 
Water, per test 0.266 


0.0640 

0.1034 

5.0000 


0.2667 

0.4310 

7.5000 


9*6000 

4.2000 

3.2000 


Actual Cost Calculations 

The calculations to be described below were done on the 
assumption that a single sample of rosin size was to be evaluated, 
using ink, lactic acid and water absorption tests only. Costs 
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rather than tline*-cons'umption were used (although either basis would 
have been valid) , because the costs, although relative, seem’^d easier 
to visualize and use. 

It was asstuned that fresh sheets were used for each type of 
test; i*e*, even when only one test per sheet was used, the remainder 
of the set was not used for other types of tests. This procedure is 
the only one which is statistically valid when correiation my ex^ 
among the various tests used. 

Evaluation costs were obtained by simply multiplying the 
cost per sheet or per test for each operation by the number pf sheets 
or tests required, and tabulating and adding the results. A!' set of 
tables corresponding to Figures 1, 2 and 3 were prepared, in which the 
total cost of evaluation, under each condition was indicated ^s a sum 
of costs of the individual operations required. In preparing these 
tables, it was assumed that only the sheets required for actual testing 
would be made. This, of' course, was not necessarily the exact truth, 
and there would be additional charges if standard sets containing a 
fixed number of sheets are always made. This was not expected to have 
any major effect upon the relative costs of evaluation, howeter. 

The total cost was obtained by the use of the follpwing 
simple formula; 

C = aP t aM 4* aS + aB 4* bT 

where a > number of sheets 
b = number of tests 
P = pulping (beating) cost, dollars 
M = Mordening cost, dollars 
S = Sheetraaking cost, dollars 
B = Blotter cost, dollars 
T = Testing cost, dollars 
C = Total cost, dollars 

Using this formula, tables were prepared showing the cost 
calculations used. One of them is illustrated as Table IX. Similar 
tables vrere prepared for each sizing test and each condition !(Mordened 
and not Mordened) used. The data in the tables we 2 re plotted and are 
illustrated in Figure 4, which was prepared from the data shora in 
Table IX. The minima shown in the curves represent the optimum number 
of tests per sheet for lowest cost at each of the CD values shown. 

A further set of plots was made from the same data, plotting 
eval\iation cost per sample versus CD as per cent of means. Selected 
“high” and “low” precision values from these ciurves were tabujAt^ 
Illustrate over-all testing costs using the three tests selected. Hiis 
summary table is shown as Table X. It was evident that the u^e of the 
Morden Refiner, althoxigh causing extra working time , resulted' in a 
lower over-all cost. 

CONCLUSIONS AND DISCUSSION 

In this paper, an attempt has been made to illustrate a 
method of determining the number of tests per unit sample tested and 
the number of samples necessary for any desired test precision, and a 
method for utilizing such data to determine lowest cost testiiig schedules. 
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Table IX 


Costs Lactic Acid Test - Not Mordened 


CD 


Sec . 

of Mean Tests/Sheet 

a b 

aP al'l 

aS 

aB 

bT 

c 

10 

13.9 

1 

23 23 $.621 — 

$ 17,250 

$.414 $ 9,200 

$ 27.49 



2 

16 32 

.432 — 

12.000 

.288 12.800 

25.52 



3 ' 

13.3 40 

.359 — 

9.975 

.239 16.000 

26.57 



4 

11.3 45 

.305 — 

8.475 

.203 18.000 

26.98 

20 

27.9 

1 

7.1 7.1 

.192 -■ 

5.325 

.128 

2.840 

8.49 


2 

4.5 9.0 

.122 — 

3.375 

.081 

3.600 

7.18 



3 

3.7 11.0 

.091 -- 

2.775 

.067 

4.400 

7.33 



4 

3.4 13.5 

.092 — 

2.550 

.061 

5.400 

8.10 

LP 

55.7 

1 

3.0 3.0 

.081 — 

2.250 

.054 

1.200 

3.59 


2 

1.8 3.6 

.049 — 

1.350 

.032 

1.440 

2.87 



3 

1.3 4.0 

.035 — 

.975 

.023 

1.600 

2.63 



4 

1.2 4.6 

.032 — 

.900 

.022 

1.840 

2.79 

80 

111.4 

1 

1.8 1.8 

.049 — 

1.350 

.032 

.720 

2.15 



2 

1.0 2.0 

.027 — 

.750 

.018 

.800 

1.60 



3 

0.8 2.3 

.022 — 

.600 

.014 

.920 

1.56 



4 

0.6 2.4 

.016 — 

.450 

.011 

.960 

1.44 


P = $. 027 ; M = — ; S = 1 . 750 ; B = $. 018 ; T = $.400 
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TOTAL COST PER ROSIN SIZE SAMPLE EVALUATED, DOLLARS 



NUMBER OF TESTS /SHEET 
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Cost of Size Evaluations per Sample 


§! 

• ‘H 

f-i OH 
0 ) ‘H 

^ o 

.1 ^ 


o 

•H 

GQ 


Q 

O 

* 

lo 

a 

cnT 

g 

•p 

o 


>3 


« 

0 

1 

O 

o 

M 


H Q, 
O 

a 


O vr\ 
H tX» 


Ch r-1 
H Cvi 


• • 

s3 

^8 

• » 

oi •« 4 - 

o o 

ifN m 


O ( 
v\ < 


88 


o 

c\i to 

« o 

LTS 

=G@= 

S ^8 

• • 

sD vQ 
H H 


42 



Although the examples used applied to paper testing, it is aghin em- 
phasized that the same technique may be successftilly employea with 
other systems involving a multiplicity of samples or preparations* 

Analyses of variance were not done on the data presented 
herein, because conventional statistical philosophy forbids the 
assumption that variances of a group of data are non-homogehepus while 
simultaneously using them in variance analysis, in which a basic 
asstamption of homogeneity is required* However, a number of questions 
arose which indicated the desirability of further work in this direc- 
tion* For example, Mordening seemed to have a definite effect upon the 
magnitude of the errors found in the ink tests compared to those found 
with lactic acid data* New experiments were planned to answst these 
questions. 


This paper represents the conclusion of this series pf publica- 
tions concerned with the application of statistical methods to paper 
sizing work. 
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ABSTRACT 


The cost of evaluation of a given sample of rosin size, or 
any other material proposed for use in a laboratory or commercial 
process, is dependent upon two principal factors* These are the 
preparation of samples and the nature of the test procedures to be used. 
The cost of each is related to the reproducibility of the processes in- 
volved* In most work involving physical tests, our experience has 
showi that the greater variation usually resides in the sample prepara- 
tion steps. 


If samples are in the form of a number of discrete units 
upon which replicate tests are to be made, as is the case with paper 
handsheets , the first step in determining the most economical evaluation 
procedure is to compute the numbers of sheets and numbers of replicate 
tests per sheet for selected critical differences between means of the 
test data. This may be done by computing “pure sheet variances” and 
“between sheet variances”, determining the corresponding standard devia- 
tions, and using these to determine the total number of tests necessary 
with Sillitto’s tables or by means of Student *s t. For a selected 
critical difference, the total number of tests required may then be 
divided into several alternate numbers of sheets and tests per sheet. 
Having obtained these data, the determination of the most economical 
combination will depend upon the relative costs of malting tests and 
making sheets. The optimum combination often does not correspond to 
the situation allowing the minimum total nimiber of tests unless economic 
considerations are ignored, since the cost of testing is generally lower 
than that of sheetmaking. 

In this paper, such calculations are illustrated, using data 
obtained from paper handsheets treated with rosin size and alum and pro- 
duced by the British handsheet machine. The same general method may be 
used in any area where an analogous situation is encountered. At Cyana- 
mid, for example, it has also been applied to the physical testing of 
chemically treated cellophane samples. 

In a previous paper (1) the determination of the number of 
tests required in a given system, using Sillitto*s method, was illustra- 
ted. This involved cases where only one test per sheet was used. This 
presentation describes an extension of the statistical procedures pre- 
viously employed in that it shows the calculations necessary when more 
than one test per sheet on a number of sheets is used. Mnimu^ 
calculations may easily be made once such data are obtained, and are 
most useful in planning economical standard methods. 
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HOW TO USE INDUSTRIAL ENGINEERING ffiTHODS STUDY EOR QUALITY CONTROL ^ 

Henry I. Matosoff 
Kwikset Locks, Inc. 

Each worker (production or otherwise) in performing his assigned 
task will either build quality characteristics into the product or will 
produce defective material. Which of these he has done and ^s presently 
doing will determine the quality of production. The industrial engiheer- 
ing approach outlines techniques that could very profitably be used to 
make this determination. 

As the mathematicians have provided quality control witK techniques 
of their profession, - the statistical techniques, so the industrial 
engineer can contribute tools of his profession - engineering Analysis 
and methods study to achieve controlled quality. However, these tech- 
niques bring greater dividends on, a) products which are to be produced 
in very large quantities at a 'tight " quality level, b) on products 
already in high volume production where quality standards haye yet to 
be determined. 

If a high degree of quality is required of a product , and we sub- 
scribe to the basic premise that "quality can only be built into a 
product," then a detailed engineering analysis is usually necessary in 
order to control the quality or production. A few definitions are in 
order before this thesis can be expanded: 

First, quality shall be defined as the quality of conformance, 
that is, does production' conform to blueprints, specifications, and/or 
classification of defects. If it does, then the product be 3£g manu- 
factured is said to have quality built into it. 

Secondly, control shall be defined as that mechanism whose primary 
end is the prevention of defects. 

Quality control engineers will readily agree that most equality 
control programs are remedial, rather than preventive in native. Be- 
cause of this type of indoctrination, many quality control engineers 
orientate their thinking in terms of "putting out fires". Thinking of 
this type tends to cause quality control departments to becoife known 
as trouble shooting departments charged with applying statistical tech- 
niques to reduce high scrap or rejection rates. In fact, maiiy authori- 
ties suggest that qmlity control programs should be started 'in troubled 
areas and gradually move from one such area to another until a complete 
quality control program is accomplished. 

For the short run, "putting out fires" is efficient and causes 
sharp decreases in rejection and scrap rates. It also builds confidence 
among production people and helps them to think using statistical con- 
cepts of variation. However, for a long range, a "total quality cdhtrbl 
program” - one where quality will be repeatedly built into a product is 
necessary. It can be achieved by a careful analysis of the methods of 
production, inspection, etc. Industrial engineering analysis methodology^ 
much the same as is used in production planning, work simplification etc. 
is an ideal way of making the required analysis. ' 
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If we are interested in establishing a "total Quality Control 
program", an analysis consisting of a detailed study of production 
should be determined. The analysis should indicate; 

1. Where are raw material, sub-assemblies, or 
parts introduced into the process? 

2. Where are manufacturing operations performed? 

3. Where are inspection operations performed? 

4. Where can defective characteristics be hidden 
or covered? 

5. Where can defective characteristics be generated? 

6. What type of gear is being used for inspection? 

This paper will illustrate how such an analysis can be performed 
on a simple operation as soldering a connector plug. 

One of the most important features in most electronic production 
is the manufacturing of soldered connections. It is not uncommon to 
find as many as 5,000 solder joints in an electronic component and a 
solder joint failure rate of one in 10,000 could possible result in a 
reliability of only 50 per cent. It is a no small wonder that some 
electronic manufactures strive for a rate of soldered joint failures 
of one in 100,000 connections. Let us suppose that this degree of 
quality was required. Here is how industrial engineering techniques 
would perform the analysis to achieve it. 

THE OPERATION PROCESS CHART 


First, a thorough knowledge of the existing manufacturing process 
is necessary and can be obtained by the use of a standard industrial 
engineering technique of process charting. Two types of charts are 
used; The Operations Process Chart and a Flow Process Chart. The 
Operations Process. Chart furnishes an overall birds-eye description of 
the entire process. It shows the way component parts which are being 
manufactured fit together. The Flow Process Chart gives more details 
and shows where items are transported, where storage takes place, as 
well as where manufacturing and inspection operations take place. 

The Operation Process Chart shows graphically where materials are 
introduced into the process, the order and position of operations, and 
the location of inspection. Two symbols are used in preparing this 
chart ; 

k large circle which indicates operation; that is, steps where an 

object is intentionally changed, either physically or chemically or 
where something is added or modified to the material, 

A square: | indicates where inspection is performed. Inspection 

is for the purpose of determing an object identification, size, quantity, 
function, and etc. As an example of the preparation of an Operation 
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Process Chart, let an electrical cable be Electrical 

a relatively simple production process and contain vital soldered 
connections whose quality must be closely watched* The first step in 
making this chart is to select the component of the cable which will 
have the greatest number of operations performed on it. Usually it is 
the part with the most dimensions., The final assembly drawing or an 
examination of the apt pal part will normally indicate the proper start- 
ing point for the chart. In this case it would not mtter it the w^ 
or the connector was used as a starting point since both hav| tew opera- 
tions performed on it . However, the connector was selected. ; 

The chart is identified by the name of the part, and its drawing 
number. The raw material used in the part is then noted on the 

chart. Special characteristics and notations such as whethe:j|' the raw 
material had been source, i^ at the vendor should be npted also. 

The first step in the manufacturing on con duit covered ca.bles is to 
receive and inspect the connector. A j ' "| square is recorded,^ on the 

chart. Since this is the first inspection, the figtire 1. is written 

inside the square [ / j . A brief description is then written' to the 

right of the symbol. After this step, the connector is disassembled. 

A circle Is placed on the chart immediately below the square to 

. . , .fj . 

indicate this operation. This is the first operation^ it is; numbered 

and described. The next operation is indicated by a-(2) and again 

described to the right of the symbol. At this point the Operation 
Process Chart now looks likp th^^ 

(1) CONNECTOR • 

Cannon SK-C16-21 3/4 


Receive and inspect 

Disassemble connector shell 

Assembly connector to 
holding fixture : 

The remaining production steps in the manufacture of .cables .arejre- 
corded. Both operations and inspections are entered, numbered, and 
described. There is little difficulty in the charting of s,b simple of 
an item as a cable until we preach the point where the wire is fM^^ 
the connector. The new part (wire) must be analyzed and the steps in- 
volved in its manufacture added to the c 

It must first be determined whether this new piece pai^ is a simple 
one, or whether it is itself made up of several “ component s If the 
latter, the principal item of this piece part is selected pp the same 
basis as was the chief component of the entire assembly. In the example. 
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the wire is a simple part which is purchased in reels and certified as 
meeting a MIL Specification, The process for manufactioring the wire is 
charted exactly as was the connector. 


The min purpose in numbering the mnufacturing steps is to identi- 
fy them for later study. Therefore, the numbering of each additional 
component does not start at 1 but follows in sequence the last numbers 
used on the chart, 

The chart reached operation(^^ and inspection p j . Thus, the record- 
ing of inspection and operations of the wire will start with(S^ and 


2 


The steps involved in the manufacture of the wire are recorded 


and when the wire is assembled to the connector the chart has reached 
this stage. 


^OPERATION PROCESS CHART CONDUIT COVERED CABLE” 


WIRE 

( 12 ) #16 
( 2 ) #12 

White -Body MIL-W-5036 

Receive and inspect 

Cut to rough length 

5 J Mark wires 

Assemble and wrap 
one cable set 


ROSIN 


[7 j Strip one end 


Aflux rosin 


SOLDER 




Tin stripped end 


(1) CONNECTOR 

Cannon SK-C16-21 3/4 
Source Inspected 

j ll Receive and inspect 

TlJ Disassemble connector 
shell 

Assemble connector 
to holding fixture 


solde: 




Tin connector pins 


Charting is then continued. When a new piece is added, it is treated 
in the same manner as was the wire. The finished Operation Process 
Chart reproduced in figure 1. gives a good overall picture of the manu- 
factured cable. 


THE FLOW CHART 


When the Operations Process Chart is completed, the Flow Process 
Chart can be started. This chart will analyze and focus its attention 
on one part or component of the manufacturing process and examine it is 
detail, A Flow Process Chart is more detailed than an Operational 
Process Chart. The Flow Process Chart used for Quality Control is pri- 
marily established to help determine where to locate inspection stations 
and what characteristic to inspect. The Flow Process Chart will show 
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the order of all operations , inspect ions , transportations and, storages . 
It will also indicate \^ere dimensions or characteristic^^ are; generated 
and where they* are hidden or covered. The Flow Process Chart is pre- 
pared with the aid of the Operation Process Chart, the component draw- 
ings, and the item in question (cables)* 


The chart is headed and identic the part being studies, its 

drawing number > and description of the first and last manufacjturing step 
described by the Floy Process Chart . Symbols are noted on tbo lefthand 
side of the Flow Process Chart, Two of these, the large /'j- circle 

and the square | j were used in the preparation of the Operation Process 

Chart and have the same meaning here. The small circle O stands for 
a transportation, the moving of an object from one place to another. 

The triangle^!!!^ represents storage, a stage in the production process 
where the material or object is intended to remain at one place. 


In addition to the symbols, the chart form also contain^ space for 
the description of each step and space for the answering of iwo ques- 
tions concerning each step* Figure 2, shows a Flow Process fthart for 
the wire which is being used in the cable asseinhly* 


One of the first in the production of a cable is the prepara- 

tion of wire. The wire is stored in racks and therefore, the'’ triangle 

is blackened and described appropriately. Since the two questions on 
the Flow Process Chart are not pertinent at this step, they are left 
unanswered. 


The next step is a transportation. The small circle ^is blackened 
and joined to the triahgle which is on the line above, The^^step is then 
described and e^^irdned. At the next step there is an operation and 4 
is entered in the large circle (4) identifying the operation as corres- 
ponds to that marked on the Operation Process Chart. Each of the 
operation steps must be^nalyzed with particular , care fin ce;;,cha^ 
tics or dimensions are usually generated at these steps, T^e first 
question on the form asks which characteristics are generated at this 
operation* At a later stage the wire is cut to its' final length. ”Is 
this measurement the final length?” If it was, then the paiMjicuIar 
characteristic of wire length is generated and the description of the 
characteristic would haye\'be|^^^ on the^^ ?lpw Process. &hart . .How- 

ever, in this example, the cut is a rough one and later 'in production ' 
the final wire length is made, thus, a characteristic is not generated 
in (T) . 

In answering the question concerning where characteristics are ^ 
generated, the entire process must be taken into consideration* The" 
Quality Control, Engineer should use not only his own knowledge of pro- 
duction, but also the knowledge of the operatpr or the foreimn. The key 
to the proper answer to the question where are c^racteristics generated 
is, ”Can final inspection of the characteristic be perforrafd at 
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this point?" If it can, the characteristic is said to be generated. 

The next step in the production of the wire is the transportation 
to the marking machine which is entered on the chart as a transportation. 
Next step, is an operation, marking of wire, and requires close study. 
The Quality Control Engineer must satisfy himself by answering such 
questions as "What happens here"? What operations does the machine per- 
form? How does each operation affect characteristics on the item being 
manufactured"? The answers can frequently be obtained by watching the 
manufacturing process and the worker doing the work. For example, the 
difference between a rough cut and a finished cut is usually apparent. 

In some cases it may be necessary to question the worker or his foreman 
in order to obtain the answers fVom experienced men. 

As the Flow Process Chart is filled, attention must' be paid to the 
question listed on the form* The first of these, which concerns the 
generation of characteristics, has already been discussed. The second 
question asks whether a characteristic is hidden or covered. The follow- 
ing definitions are applicable: 

Covered; A characteristic that could only be inspected by a 

later non-destructive disassembly operation. Example, 
thread characteristics of an assembled nut and bolt. 

Hidden; A characteristic that cannot be inspected by a later 
disassembly operation, because the disassembly opera- 
tion would destroy the parts involved. Example, the 
finish of a surface which later is painted ; bevel of 
an edge which later is welded. 

When the question of whether a characteristic is hidden or covered 
is answered "yes" the characteristic in question should bejdentified. 

An example of a hidden characteristic occurs at operation in the 
manufacture of a cable. This operation of tinning may covfer wires 
which may have been knicked in the stripping operation or which may 
have been stripped short. 

The Flow Process Chart is completed by charting the steps in the 
manufacturing process to the point indicated by "Chart Ends". A 
separate Flow Process Chart should be prepared for each component. In 
this way a series of charts will be developed covering a manufacture of 
the items under study* The completed charts must be carefully checked. 
It is most important to make sxire that the generation of every charac- 
teristic has been entered in the proper step. When the Flow Process 
Chart has been completed and checked, the basic data concerning the 
manufacturing process has been collected and further analysis as to the 
location of inspection stations may begin. 

"THE LOCATION OF INSPECTION STATIONS" 


After the actual manufacturing processes are studied, through the 
use of the Flow Process Chart and the Operation Process Chart, the 
Quality Control Engineer is ready to determine where to locate points 
of inspection and what characteristics should be inspected at these 
inspection points. 

At this point he should also be in a position to suggest changes 
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in manufacttiring or inspection methods* In the example being "nsed, the 
new inspection station location accomplished all the methods changes 
desired. . ■ — fr- 

Before inspection stations can be located, several managltiient deci- 
sions are necessary. First management must decide whether the '’Inspector” 
or the "product ion ’V approach of inspection shall take place* ;; The ’’in- 
spector” approach is that an item be inspected as late in thej' manufactur- 
ing process as possible. This is the type used by the Militaiy for 
purposes of acceptance inspection. The "production” approach, usually is 
that the inspection should take place as soon after ah operation as is 
possible. Normally the Quality Control Engineer will advise management 
on the use of a modified approach, that is, to inspect as late in the 
process as is possible, but before a vital cheiraeteristic is covered or 
hidden. The cost of having discrepant material in the manufacturing 
system will dictate management ^ s decislpn . In ahy case , the 'Operat ion 
Process and Flow Process Chart will help crystalize the area;; of decision. 

Secondly, management must consider the cost of inspect ipn. This 
will be decided by the complexity of the item and the quality which is 
desired by the customer. The AQL, AOQL, and/or the Classification of 
Defects can greatly assist management in this decision. In |he case of . 
the solder connection, the cost of inspection was dictated by the AOQL 
of one defect in one hundred thousand connections. 

Thirdly, management must decide the rate of its production. If the 
rate of production is ten units, different methods, techniques, or con- 
trols will be used then if the rate were ten thousand units*; 

Let us suppose that in the e:3^mple of the solder conne<ibipn manage- 
ment *s decisions is reliability at all other cost then quality dictates 
all other considerations. li 

If this is the case a modified inspector's approach is^used. 

(Inspect as late as possible, but before characteristics are covered or 
hidden). Using this approach, normally both the desired quality and a 
reasonable cost of inspection would result. If it didn't, the produc- 
tion approach (that is, to inspect as soon after an operation as possi- 
ble) would have been instated. 


WHAT CHARACTERISTICS MUST BE INSPECTED 

1. Improper wire size 

2. Dnproper wire length 
(short or long) 

3. Continuity of wire reels 

4. Wire identification number 
improperly spaced 

5. Bulges or tears in wire 
insulation 

6. Wire stripped too far 

7. Wire stripped too close 

B. Wire not stripped square 

9. Outside diameter of wire 
reduced 

10. Presence of flux or rosin 
in solder 


11. Cold solder 

12. Excessive solder 

13. No solder 

14. Too little solder 

15. Bizrhed insulation 

16. Missing wires 

17. Duplicated wires 

18. Wrong plug 

19. Damaged plug ; 

20 . Crushed pins j 

21. Cracked plugs .or inserts 

22. Wire not f lusli; in pin 

23. Reversed wires 

24. Presence of foreign material 

25. Wrong size of ! vinyl cover 
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2$. Loosely tied bundle 

27. InqjToper length of Tinyl 
cover 

28. Missing, loose, or damaged 
plug screws or plug threads 

29. Improper cable length, or 
size 

30. Improper cable identification 

31. Damaged or crushed conduit 

32. Improper location of plug 
insert, relative to plug 


WHERE TO INS PFP.T 


33. Ferrule Improperly 
assembled to cable 

34. Improper lug size 

35. Less than ohm 

on megger 

36. More than - - - ohm 
on continuity test 

37. Lugs not fastened 
sectirely 

38. Wire on lugs extended 
too far 

39. Identification not clear 


Quality Control Engineer must determine \diere in thn 

quL\orwara?^v^Jf?poati^infthe^?o2^^ 


WIRE 


COHNECTOR 


Tin stripped end 


ooxaer ^ - 


Solder — - 

Solder 

Solder - « . 

Cover — * 

Sh Assembly shell - 

Run wire 




place^teSe'1haSc?eSstS°ci^ inspection must take 

defects may have been generated. The CTi^i^tlf^^ere^^'S^peSL 

stations, using modified inspector's approach, were located. 
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Tin stripped end 


CONNECTOR 


3 ) Tin - - 


nm Solder — - 
Brush - - - 


Solder - - - 
Brush - - 


Solder - - r* 
(15) Brush - - - 


t Solder - - - 
Brush - - - 


(20) Bundle and tie - 


t Assemble shell - 
Tag and identify 


Since you cannot inspect that vhi<^ has not been prbdwed, only 

the characteristics which are generated b^ore they re^h 
tion station can be included on the inspection list, 

it a list of characteristics that mst be inspected at each inspection 
station* 
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INSPECTION 


0 


Improper wire size 
Bulges or tears in insulation 
Stripped ends more than l/h» or 
Ipss than 3/1^'" 

Wire knicks at stripped end 
Stripped ends not cut square 
Improper wire lencth 


INSPECTION 

Stripped ends cold soldered 
Stripped ends excessive soldered 
Stripped ends not soldered 
ftirned Insulation 
^cess of rosin or presence of 
foreign matter at stripped ends 

ii!srecTioN(^ 0 0 0 

Wrong wire in pin 

Wires misning 

Duplicate numbered wire 

Crushed plug pins 

Pin filled with solder (female 

connection) 

Excess solder 
Too little solder 
Cold solder 

Wrt, chips, excess of- flux or 
foreign matter present 
Cracked plug or inserts 


INSPECTION 


0 


Improper vinyl size, fits loosely 
over wire ^ 

Improper vinyl length 
Missing vinyl covers 
Cable wires not firmly bound 


INSPECTION 


0 


Wrong pl\ig 1 St 2 used 
KlMlng coupling parts on plug 1 2 

Irabroper cable size or length 
Improperly assembled cable and olue ] 
Iraprop‘.‘rly marked cables ^ 

Cable bands missing 
Crushed or damaged cable 
Ferrule improperly assembled to cable 
plug 1 

Ferrule damaged on plug 142 
Improper location of insert on plug 
ref, drawing 

loose, missing, short, burred or 

stripped threads on plug 1 

Excess solder 

Too little solder 

Cold solder 

Pin filled with solder 

Dirt, chips, excess of flux or 

foreign matter present 

Wix>ng wire in pin (plug 2) 

Wire missing (plug 2) 

Duplicated numbered wire 
Crushed pins on plug 2 


ref, M,o., wire gage or comoare visuaHy 
visual 

rule 

visual 

visual 

ref. drawings, rule 


visual 

visual 

visual 

visual 

visual 


vl.sual 

visual 

visual 

visual 

visual 

visual 

visual 

visual 

vlaual 

visual 


fesl 

visual >rule 

visual 

feel-visual 


visual 

ref, drawing rule 

ref, drawing visual 

visual 

visual 

visual 


ref, drawing 
visual 

rule 1/16 graduation 

visual 

visual 

visual 

visual 

visual 

visual 
visual 
' visual 
visual 
visual 


INSPECTS 


noN^ 


Caole plug does not fit board plug 

reading less than — ■ « megohi 
continuity test more than - - - o^ 


visual 

visual 
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FINDING THE FACTS BEFORE SETTING THE SPECIFICATIONS 

II METHODS.... 

Julian Harrison Toulouse 
Owens-Illinois Gla.ss Co. 

Let us first establish one or two fundamental premises, Jirst - 
that almost every business organization is at the same time Ijoth a 
buyer and a seller of some form of product or raw material. My 
company, for example has thousands of customers, but we odrselves 
are customers to hundreds of other suppliers. The same is |rue M 
every organization here represented. 

We follow specifications for the things we buy as well as the 
things we sell. Because of manufacturing information required, the 
blueprint details of a bottle for the most meticulous customer differ 
little from those of a bottle for a customer who may not know that 
blueprints are needed. And the same is probably true in any field of 
manufacture, Irom f^^rps to diesel locomotives, from lipstick 

to the mechanisms for nuclear fission. I 

Secondly, each of us sits on both sides of the bartering table. We 
must listen to the se.me details about the quality standards of the things 
we sell, which we use about the things we buy. We desire high 
performance of the things we buy - we must agree to give high per- 
formance in the things we offer for sale. The inter -relation of the 
buying and selling aspect of each company becomes like a piece from a 
jig saw puzzle, or like the Yang and .Yin of Chinese philosophy, each 
part finding its harmonious counterpart. 

Then too, let us not think of specifications as being part of only a 
producer -consumer relationship. Many more specifications exist 
entirely within an organization, a matter of greatest concern only 
between departments of the company. Take an automobile, fpr 
example. Hundreds upon hundreds of specifications are necessary 
for the component parts of their assembly, and these specifications 
(except to the suppliers of materials) largely never get outside the 
place of automobile manufacture. What passes for "specifications” in 
the sales literature are merely recitations of a few standard 'dimen- 
sions, with a hint as to performance. 

Whether hinted or spelled out in detail, performance is exactly 
what is exchanged over the trading table. It is fundamentally true that 
the only excuse for specification in any regard is to outline some 
necessary phase of performance. Herein lies the reason, the basis, 
and the whole excuse for any expressions of specification, of tolerance, 
or of descriptive intent. All too many specifications go beyond this 
point into the field of conjecture, coercion, or fantasy to the end that 
difficulty is made certain, costs pyramid, waste is inevitably, and 
the specification itself becomes an anathema. 
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To this problem, I once made the plea - ’’find the facts before 
setting the specification”, in a speech by that title (1). This plea is 
now renewed, and my part of today's program is to tell by example 
some of the methods by which facts can be found. Since I so 
completely believe in the use of the statistics of probability as a tool 
for study, the methods I will mention will all be statistical. In a 
sense lam using the need for facts to show how statistical approaches 
can be made. 

I want to make clear at the outset that I believe too few specifi- 
cations arise out of the facts of performance, which should be the 
only reason for a specification. Too many specifications are based 
on concensus and compromise of opinion, or on mutual distrust, or 
out of the game of claim and counterclaim. I believe that specifi- 
cations should be arrived at by free discussion of the needs, and when 
so established, should be met and enforced. 

Dr. Gailliard has detailed the correct idea of specifications - let 
me add some incorrect methods of arriving at a specification, by 
name and description: 

Fig. 1. The Fine Print Method 

Too many specifications include many details not 
necessary for actual use of the article being 
specified. Blue prints for manufacture may have 
many dimensions necessary to develop the article. 

Too often a specification for compliance includes 
every dimension on the blue print. Don’t confuse 
a specification detail with a working drawing. 



FINE PRINT 
METHOD 


SPECIFYING DETAILS 
NOT NEEDED FOR PERFORMANCE 
BUT DEMANDING COMPLIANCE 


Fig. 1 
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Fig. 2. The Umbrella Method 

When specifications are the res^t of a group 
discussion of standards, they are often drawn 
so that "nobody is left out". When 
with a group of producers, it is often set so as 
to include the weakest number of the group. When 
concerned with a group of consumers, it is often 
set to include the tightest specifications desired 
by any one member. 


UMBRELLA 

tUlfPiSp ' 

y 

DESIGNED SO THAT EVERYONE , 

... ■ ii 

CAN GET UNDER 

Fig. 2 


SHOTGUN wedding 


METHOD 


A FORCED UNION ARISING OUT OF 4 
DOMINANCE 0Y EITHEB SIDE 

Fig. 3 
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Fig. 3. The Shot Gun Wedding Method 

Dominance of one side of the agreement results 
in a forced union. Compare the terms ’’buyers 
market” and "sellers market”. Each produces 
a different idea as to specifications. 

Fig. 4. The Keeping Up With the Jones' Method 

Sometimes specifications are copied from another 
source without regard to the suitability. 


KEEPING 
WITH THE 
JONES' METHOD 

COPYING ANOTHER, AND PERHAPS 
UNRELATED, SET OF SPECIFICATIONS 



Fig. 4 


Fig. 5. The Go You One Better Method 

Setting tighter specifications, just to gain or 
maintain a reputation for toughness. 



METHOD 

ELABORATION AND EXACTINGNESS 
FOR PERSONAL GRATIFICATION 

Fig, 5 
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Fig. 6. The Fiction Writer Method 

So far removed from the needs as to have no 
resemblance to "persons or events". 



fiction 

WRITER 

METHOP 


ANY RESEMBLANCE TO PERSONS OR 
EVENTS IS ENTIRELY ACCID&NTA^ 

Fig. 6 

Fig. 7. The Ostrich Method 

Entered into by burying one's head in the sands 
unaware of what is going on, completely ignoring 
the subject. ^ 

■■-H- 

OSTRICH ' 
METHOD 


BURYING ONEfS HEAD, UNAWARE 
OF WHAT IS GOING ON 

Fig. 7 
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Fig. 8, The Peas in a Pod Method 

Desired by the perfectionist. He cannot believe 
in variation - all articles must be exactly alike 
(but did you ever look at a pod of peas ? ). This 
man sets tolerances as the smallest number he 
can think of, divided by two 

PEAS IN A 
POD 

METHOD 

BELIEVING THAT THINGS DO NOT 
VARY EXCEPT BY CARELESSNESS 

Fig. 8 

Fig, 9. The You Go Your Way Method 

Complete disregard of specifications. Often 
set tight by engineering, hoping that production 
will come close, or knowing that production will 
set its own standards. 

YOU ^ 
WAY 

METHOC:) 

ENGINEERING SETS TOLERANCES TIGHT 

BECAUSE PRODUCTION WILL MODIFY 
THEM IF IT SEEMS NECESSARY 

Fig. 9 
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Fig. 10. The Hairline Method 

Tolerating no deviation whatever from tolerance 
even by the most minute amount. No concept of 
’’Average Out-going Quality" and statistics. 

No "Material Review Committee" tp decide on 
borderline quality. 



THE AX FALLS ON A HAIRLINE DEVIATION 


NO MATERIAL REVIEW CQMMI XTEE 

Fig. 10 

Fig. 11. The Accent the Positive Method 

Sometimes based on what Irvin Bross in his 
’’Design for Decision" calls a "selective amnesia 
for the facts" - largely exaggeration and cover 
up by both sides emphasizing only that which is 
favorable to the side concerned. 



A GAME OF EXAGGERATIQN AND COVER-yP. 

'selective amnesia for the facts 

BROS$ 


Fig. 11 
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Fig. 12. The Damn the Torpedos Method 

No regard for the dangerous waters of the increased 
procurement cost to an unnecessarily tight specification, 
or the line production cost of using materials procured 
under loose or inadequate specification - can go either 
way, in spite of an intermediate channel. 


DAMN THE 
TORPEDOS 

METHOD 

SETTING SPECIFICATIONS REGARDLESS 
OF MATERIAL OR PRODUCTION COSTS 

Fig. 12 



If accurate costs are obtained we can make a mathematical 
comparison to find the best-cost-specification. Line costs decrease 
with less variable material, and increase as the variability increases, 
as shown by the curve labeled "Cost of use increases with loose 
specifications". Procurement costs go up with tighter specifications, 
simply because it can cost more to make such material, as shown by 
the curve marked, "Purchase cost increases with close tolerances". 

The real cost is their sum. In this chart they are added 
graphically to give the curve labeled, "The combined costs pass 
through a minimum point which can be calculated". This minimum is 
the best specification for the user, and it is shown that it can be 
missed slightly without serious difficulty. If each curve could be set 
up mathematically with "X" as the variation in tolerance the minimum 
point can often be calculated by the Calculus. The graphic method 
differs only in the ability to make determination at enough points to 
determine a smooth curve, whereas the Calculus smoothes out 
irregularities. 
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A COST RELATIONSHIP DUE 
TO CHANGE IN SPECIFICATION 


.THE COMBINED COSTS PASS 
\ THROUGH A MINIMUM POINT 
\ WHICH CAN BE / 

X CAUCULATED / 


CHASE^ THE MINIMUM CAN J 
COST IN*\ BE missed] A LITTl^ 
CREASES XwiTHOUT IMUCH/^ 

WITH CLOSE X EFrECT>// 
TOLERANCES OF USE 

WITH 

XnJ^OOSE SPECS. 


MOST economical] LEVEL IS AT 
THE MINIMUM POINT SHOWN ABOVE 

TOO 1 “TQQ - 

TIGHT y» ' loose 

INCREASING LATITUDE IN SPE CIFICATION 

Fie. 12-A 



Now in detsLiling some typical statistical approaches to\s^ard 
finding the facts before netting the specification, I can only hse a few 
illustrations, Each busines.S. has its own problems, to which these 
can only be adapted by one knowing the industry. I will first mention 
a few covering the product, then the consuming side (which may be a 
customer or another 4 in the same business or garil^iatipn), 

and finally the producing side (even if only the preceding coihpany 
department). The methods need ,..axe. of,. :Co^IJJ.,np£.th 
prerogatiye of eithe?* producer or consumer, nor are the things that 
are measured. 

The Product 

1, Distribution of Measurements of a de^ in relation to a 
specification. 

Let us first illustrate what is ca^ distribution", for 

the benefit of the non- statistical. S we took one hundred d^^ 

and measured their thickness. Suppose we set up a pile for each 
increment of thickness, letting the number pf dimes in each pile 
therefore illustrate the relatiye ”fr^ of each thickness, Such 

an array is called a distribution, whether an actual assembly of the 
parts, or by a graph in which the heights of bars or lines, or the 
positions of a series of dots exemplify the situation. 
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Such a "frequency distribution" so often presents a regular bell- 
shaped contour that the individual piles or bars can be shown as 
though connected by a smooth curve - the "normal curve of 
distribution" - often, as I will do in the rest of this presentation, all 
this is shown simply by drawing the curve itself, carrying the 
implications that measurements have been made, and the curve 
merely connects, graphically, the tops of the piles, with its high 
point representing the approximate average, and its tails fixing the 
extent of variation from that average. 

The graph of the thickness measurements of those 100 dimes, or 
any given number of measurements of any other thing, shows visually 
two of the fundamentals of all probaMlity statistics - a measure of 
the average , usually symbolized by X, and a measure of the spread 
of the curve (sigma), wherein a distance of three times sigma on 
either side of the average usually includes 99% or more of all of the 
measurements. This useful measurement of variability is perhaps 
the most important mathematical tool of the statistics of probability. 



Fig. 13 


2. Relation to Production and Specification Tolerances 

Now let’s symbolize a relationship between a product of a 
manufacturing line, and the specification tolerance limits by using the 
normal curve and appropriate limit lines. The fact that the curves 
are broad or narrow does not matter - only their approximate shape. 
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Figure 14 -A shows a curve ext beyond the tolerance liinits 
on both sides. It indicates great variation with respect to the tolerance 
limits . This is an untenable situatip^^ Either the fringe iyirig burside 
each tolerance must be, removed by measuring in detail every item 
produced (a costly procedure at best), or a new and better prpduction 
method must be found (often a matter of research and delay), or some 
way must be foiand to m wider limits feasible, by altering the method 
of using the product. 

Figure 14-B shows the curve just clearing inside the limits on 
either side. First thoughts might be that this is perfect, but :it is far 
from ideal. No operating tolerance of any kind is possible, and the 
dotted lines show how the product can be partially out of specification 
by only a slight shift of the average. 

Here is where many specification writers drop into a pit -fall. 

They measure a few items, which cannot contain both extrenq.es of, the 
product, or even one extreme, and then set limits about the range of 

these few samples. For example, the probable variation of tho 

product fx, pm whi^l^^ a of 5 is taken would be on the pxder pf tj^p 

and one “half times the spread (or range) in measurement of the five 
items. The average spread of five items randomly sampled is shown 
by the short, double arrow. ;■ 

Figure 14-C shows a more comfortable situatipn, one which 
allows some manufactuH leeway, some degree of tool wear or 
similar variatipn» and some degree of latitude for combining the 
product of two or more machm Under this cphditipn 

one can expect good compliance with a specification. 



SOME DISTRIBUTIONAL ASPECTS OF SPECIFICATION 

' ' ■' • '!! 

Fig. 14 
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3. An area study 


Other measures of product condition can be used. Chart 15-A 
shows a common condition of paper board, as shown by Mullen Tests, 
six inches apart in every direction, first as originally taken, then as 
combined into averages of each group of 9 which forms a square. 

The average of each group of 9 is placed in its center on Chart 15-B 
with cross-hatching to show zones. A different idea as to the board is 
obtained from the area averages. Possibly this explains, and gives 
an idea as to, the decision "when is paper wild?". It also shows 
why a true random sample is needed for any evaluation. 

Grouping the Mullen test samples In one area would give 
erroneous results, yet so often this is done. A completely different 
evaluation would be made if six adjacent samplings were made in 
either the low or the high test areas. 

Thus we have given three different kinds of study of a product 
isolated from production - a frequency distribution, a specification 
adherence probability, and an area study. Each might give an 
answer to the question of adherence to specification, but they are 
only a few of many examples of possible product variation studies. 


MULLEN VALUES: INDIVIDUAL 

ONE TEST IN EACH SIX INCH SQUARE 
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Fig. 15-A 
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MULLEN S/ALUES: AVERAGES OF NINE 


FROM ONE TEST IN EACH SIX INCH SQUARE 



Fig, 15-.B 


The Consumer 

1, Line Operation 

We can only hint at what might be studied in a lipe operation. 
Perhaps you have already made up your mind as to the cause, and 
study only that one cause over a short run. If you do, you maly be 
badly out of line; you may be gathering only those data which prove 
your point - one form of the selective amnesia alTOady mentioned. 

Set up an extended study recording all the npn-conforminjg units 
found, separate them as tP classes, and tabulate the stage in the 
process, forming a table similar to Fig. 16. 
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Table 1 


A process line survey, over an* extended period 




Stages 

in the process 



% of 

Class 

1 

2 3 

Non -conforming units 

4 

Sum 

Grand 

Total 

1 

606 

1093 

235 

319 

2018 

45.23 

2 

227 

208 

84 

99 

634 

11. 97 

3 

38 

46 

5 

5 

89 

1.99 

4 

38 

37 

7 

28 

103 

2.31 

5 

27 

27 

25 

67 

121 

2.71 

6 

84 

64 

69 

326 

474 

10.62 

7 

74 

97 

35 

236 

407 

9.12 

8 

26 

218 

74 

204 

448 

10, 04 

9 

3 

2 

9 

107 

112 

2. 51 

10 

0 

7 

0 

1 

8 

. 18 

11 

0 

0 

0 

3 

3 

.07 

12 

14 

33 

54 

98 

145 

Grand Total 

3. 25 

Sum 

1137 

1832 

597 

1493 

4462 

- 

% 

25. 5 

41. 1 

13.4 

33, 5 

- 

- 


Now for a bit of statistical slight of hand. Class 1 appears at all 
four stages in the process, but mostly in stage 2. Is the reason due 
to raw material or to something in the stage? If the former, perhaps 
there is something to do in the way of a specification study; if the 
latter, it would be better to get to work on the properties of the stage, 
the machinery, the process or the like, in addition to the specification 

The statistician here applies a significance test - a mathematical 
procedure which, within limits, answers the question - are these 
two sets of data really different, or could they reasonably come as 
two separate samples from the same system of causes? In this case 
it can answer the question: Is the number of non- conforming units 
different enough that the controlling cause is the stage, or is there 
enough similarity that the cause is something to do with the class, or 
something common to all items of that class as raw material, etc. 

There are many formulas which can be used to estimate the 
significance of a pair of results. Since this production was of a 
large number of units and both figures to be tried come out of it, we 
might use the very simple formula for numbers in an area, although 
it is not the best to apply. 
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Now, since it can be statistically shown that any value of t greater 
than 2.6 is an indication that tbe same sy stern of causes could not 
reasonably give both of the values c one we can concentiiate pn 
stage 2, and omit stage 3 for the moment. Let's now see if 1 is 

significantly different than stage 2. 


t = 


1093 - 606 487 



Thus we have fPUTid that the data is worth looking into. 

We still do not know if it is the ra stage 2 process, or 

a combination of several causes but a planned experiment could find 
the answer., . 


The first PI* you. may make is that all this,^was quite 
obvious since in class 1 contained pne-fpurth pf^U the non- 

conforming production. True -• but seidom dp we find suph da^ta 
available. This table was deyelpped when the producer went into 
the consumer's plant and got it . The consumer^ hadn't eveu thought 
of such necessity for good data I This is the real point of the discus sipm 
A study pin-pointed the reason^ and the reason in this j^SrS.e 
to be machinery maintenance - not a need for a specification change! 

A further step, and better, is to divide the data. c pile period 
into sub-groups. The preceding was a three month study. Let's 
look at a comparison of three weeks in another study. 

While we could use tests of significance, the above can b!e judged 
by another technique - analysis of variance. Without going into 
d e tail s , its ho wed that the r e wa s no r eal s ignificanc e b e t WPeh the 
days of operation, but that there was real significance in the ‘ classes 
of non-conformity. Also, stage 1 was not much changed day*^to-day; 
any improvement here would be a matter oces s and 

could be permanent. Stages 2 and 3 were yariable, meaning that 
some cause was Open's. ting which changed from day to day. It 
illustrates the possibility of what the statistician would calL 
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assignable cause. In this case it had much to do with the ability 
of inspectors. 


Table 2 

A three week process line study 


Stage 

8/4-8 

Days 

8/11-15 

Non-conforming units 

8/18-22 

Total 

1 

188 

288 

208 

624 

2 

15 

79 

49 

143 

3 

167 

151 

119 

437 

Total 

370 

458 

376 

1204 

Units 





Processed 

473610 

670700 

608310 

1752620 



Converted to percent by weeks 







1 

.0397 

.0429 

.0342 

,0356 

2 

. 0032 

.0118 

.0081 

.0082 

3 

.0363 

.0225 

.0196 

.0249 

Total 

.0782 

,0772 

.0619 

. 0697 


We gained a lot of ground quickly in respect to the process, but it 
was done by a planned experiment involving separation of causes, and 
not by overall data haphazardly arrived at. Analysis of variance is 
only one of several '^designs for experiment” which give more 
credible facts for decision purposes. They are what statisticians call 
"Decision Functions" because they measure the probability that an 
assumed answer is the correct answer. And what business man 
would not give his right arm to know how to be correct in nearly 
every decision! 

A final process study is shown as Table 3, where five similar 
plants used the same methods and supplies. 

These data are in percent of the total non-conforming material 
found in any one plant and merely illustrate this point; That the 
difference between plants was more often the cause of non-conformity 
than the raw materials . 
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Table 3 


Five plants using the same materials 


Stages 


Plant 

1 '2 

% of all the non 

-conforming units involved 

A 

62.2 

4.4 

6.5 

25.2 

1.7 

B 

40.0 

11.6 

26.3 

22. 1 

0 

C 

45.3 

9.1 

18.6 

22.4 

4.6 

D 

56. I 

14.2 

9. 1 

17.8 

2. 8 

E 

17.8 

17.8 

32.2 

17.8 

14.4 

Avg. 

52.7 

11.1 

12.7 

20. 5 

3.0 


2. A performance test 

Now we can coin e to a performance test^ typical of mapy, but in 
which a new principal of design in corrugated containers is possible. 
This is a study reported in the Journal of the American 
Testing Materials, and involves cur yilinear correlation (2). 

The logic of the study was this: One of the tests of a corrugated 
package is the Conbur test, or simulated damage in a freight car by 
a sudden change in speed, usually deceleration as in s witching and 
bumping another car at slow speeds. It has reached a point of high 
confidence as a performance test. occurs, it must be 

through the crushing of the corrugations to allow an almgst, 
uncushioned impact. Figure 1 6 ill us t rat e s thi s . ; 








-WJOTH- 


Fig. 16 
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One measure of corrugated board quality is the force necessary 
to crush the corrugations. Perhaps we could use the crush test in a 
correlation with the conbur test, thus relating a laboratory test, for 
specification purposes, to a performance test. We could then specify 
the strength of the board necessary to carry a product safely. 

We had data as to the crush test of a number of boards and as to 
the conbur test of a number of products packaged in them. Figure 
16 shows what happens when a bottle crushes half way into the 
corrugations - an area is contacted. We are dealing in this 
illustration with non-test flute. 

The formula for a hyperbola seemed to be applicable because it 
would be compatable with no-crushing and therefore no damage when 
the load comprised of the weight of bottle and content approached 
zero, and no resistance when the load approached infinity. Therefore 
we equated the load concentration of the article contained (its weight 
divided by the area in contact with a half-crushed corrugated wall) 
with the conbur foot-fall result, using the method of least squares, 
and the formula, Log X = n Log Y - Log K, and obtained the curve 
for a specific material shown in Chart 17. 

Now we are ready for design matters. Suppose it were decided 
that a minimum of 20 foot-falls were to be desired. The half-gallon 
and gallon bottles could not be packed in this non-test medium. The 
others could be packed. Thus one could specify this board, among 


•■J5 






/Ax. 




7i> 

kl* O.B 1.0 I.e 1.4 

Fig. 17 
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others, for use, limiting the size of the cQTitaimr^^ 
could be used. A stirpnger board, probably more costly, would be 
specified for the gallon; it would cost too much tp use where ij was 
not needed. 

This, then, illustrates a use of curvilinear cor relaUpl!^^-!^ 
the f a c t s before s e 1 1 ing the specification. 

3. Additive Tolerances 

One concern of specification writers is the oyerall tple^^^ 
assembly of several parts. Thus, if several piece-parts are" 
assembled, it is a popular idea that the tolerance of the a-ss§ftbly 
becomes the 8vm:i of the tplera^n^^^^ individuals. In othe^r words, 

people assume that if 5 items are assembled together and each has a 
tolerance of . 002", then the resulting variation of the assembly 
would be 5 times . 002 or . 010". Then, working backwards, if .010" 
seemed too much, the designers might feel that a lower figure 
would be necessary, say (generously, they hope) of . 0075** either way. 
Then they would divide by 5 and as sign . 0015" to each individ^l or 
three-fourths of the original figure of .002", In other words, the 
individual tolerances are now tightened in order to achieve an^ pyer- 
all goal. 

By the laws of probability, it would be an extreme rarity to 
bring together all 5 items of the assembly at the high or at the Ipw of 
their respective distributions . In random ass em we would expect 

the five pieces to represent all degrees of their respectiye 
distributions, some high, some low, but mostly near their mid -points . 

For example, if one in every 1000 units were on the, high tolerance, 
the chance of getting five of them together would be (1/1000)5 or 1 in 
1, 000, 000, 000, 000, 000 (one thousand miUApn^^m^ asseminlies - 

not a very probable occurrence. 

The real problem is not the chance of these getting 
together, but of finding the probable practical spread of random 
assemblies 5 items, or what spread would contain 99 plus percent 
of all the aseemblies. Roughly this would proceed as follows:;: 

The only data we have is the jv . 002** pr . 0 spread aliowed 
units of each kind. If the normal distributionjast * 'filled" the 
tolerance (the worst possible condition) this would be equivalent to 
6 sigma which Dr. Edwin Olds, who has done muoh to^^^s^^^^^^ this 
condition (3), calls the "natural tolerance". He then sets up the 
formula: 

= \/!t'2*‘3 + '4 + '5 
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.00894 




5(. 004) 


\/ 000080 


Thus, in practice, the maximum spread of the 5-item assembly 
would be . 00894 or . 00457’* on a side, well within the . 0075*’ either 
way which was set as a working assembly tolerance. 

Now that we have the camel's nose inside the tent, let's go in a 
little farther. The specification writer conceded that . 0075” would 
be enough. We might see how wrong it was to set .0015” for the 
individuals. We simply set up the formula to let X equal the 
individual 6 sigma limit, and solve for it. 



= 

t2 

“■s 

= 5X^ 


= /5 wi 


= . 000045 

X 

= .006708 

X/2 

= .003354 


We could have set the individual item tolerances at .003354” 
either way (or round it off to . 003”) and be quite certain that no 
trouble would occur in assembly. In other words, the tolerance 
could be made half again larger. 

The Producer 

Now let us turn to the producer and a very few of the many 
applications he can use. For one thing, the producer has a big 
advantage. Where the consumer could only look at the product as a 
whole (as a grouped population in a shipment, for example) the 
producer can break up his study into sub-groups taken during pro- 
duction, This has one big advantage - he can remove for detailed 
examination only that portion of a production which needs it. 

Five problems will be illustrated: 

1. Correlation of Specifications. 

Sometimes a change in the method of expressing a specification 
is desirable during production (1). An example is given for the 



capacity of a glass container. It may be desirable to the cotishmer 
to have the capacity for the content he puts into the bottle to center 
on a point in the neck of the bottle. The producer, because he 
controls capacity by the difference between mold displacement and 
volume of glass per bottle, may more easily use the complete or 
overflow capacity of the bottle. He must then have some cQjf relation 
between the two specifications so that he can control one by 
measuring the other. The method used is known as a correlation 
analysis. 

Figure 18 is a graphical portrayal of the method. Each' dot on 
the chart is for a single bottle. Each dot at the same time shows the 
overflow capacity and the height on the side of the bottle to which 
the stated contents would come. The several hundred dots cjin the 
chart represent the measurement of that many bottles from several 
manufacturers. The correlation is good. 

One usually starts with a table, giving for each bottle the two 
measures made, called ^'paired observations”. It usually pays also 
to plot the data at this point because if the graph shows an obvious 
lack of correlation, the calculation step need not be taken, :Usually 
however the calculations are carried out and result in the fojrmula , 
for a straight line which gives the average correlation together with 
the outside limits of the variation. 



In this case a simple transition answered the specification 
question. The fillpoint specification had been "guessed" too low by 
about an eighth of an inch. The "zero" or ideal of the overflow was 
equivalent to that amount from the assumed filling point ideal on the 
scale to the left. The filling point equivalent to -1/8 oz. overflow 
(the minimum tolerance) was +.34", and that equivalent to the 
maximum overflow of +1/4 oz. was at -.32", both measured at the 
assumed ideal fillpoint. 

This process then gave the producer a working specification in 
one term* which could be translated during production to the language 
of another specification. 

2, Tool Wear 

One common mistake in specification writing is to measure a 
few items and then set a specification which assumes no further 
variation. Where this is most dangerous is in operations such as 
machine tooling where the tool gradually wears during production. 
Every time a tool must be removed for grinding, there is loss of 
production until the new tool is properly set. This is an economic 
loss which must balance with the specification limit. If limits are too 
close, the constant re-setting of tools would make the cost prohibitive. 




By permission from "Engineering Statistics and Quality Control" 
By: Irving W. Burr 

Copyright, 1953. McGraw-Hill Book Company, Inc. 
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What is needed therefore, is a specification whiph w 
moderate ^ear At the same time of warning must be 

given as to approach to the specification limit, 

The result is a control chart wit lines for averages and 

limits, such as I show here from Burr*s ’’Engineering 

Statistics and Quality Control”, P, 269 (4). 

The spread of the averages of samples of 5 consecutiye .p-nits is 
shown as the vertical distant between the dotted lines. Th]p true 
(probable) spread of individuals would be shown by one of the! lie a vy 
normal curves to the right, filling only about half the specification 
distance. Consider the s^e^ line curves as the beginning and 

ending positions with many positions in between, 

This graph shows a fairly workable condition of specificatipn. 
The specification spread is twice the spread from any one time. 

Tools would last abo^ If the specification were fcut in 

half, tools could be used about 10 or 15 minutes - an impossible 
c ond i ti o n e c pn Q|n i ca U y . 

3. Effect of reducing a specification tplerance 

This leads to a question as to what would happen if a specifi- 
cation tplerancp w^^^ 20 gives a graphical 

analysis. ' 

Suppose the total tolerance^ on some scale, were 140 nhits. 
Suppose the spread at any one time of production was 40 of i-hpe® 
units. (Ignore for the moment the cry ’’you don't need all that 
tolerance!',) 



Fig. 20 
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Perfectly controlled production would mean that it started with 
the 3 sigma tail of the distribution curve just touching the left hand 
tolerance and continued until it crossed the graph and the opposite 
tail just touched the opposite tolerance. This could just as well be 
shown by the centers of the two curves. The operating range would 
be 100 units. 

Now suppose that the tolerance were cut in half. The secondary 
position of the curve is now moved so that the 3 sigma tail touches 
the new tolerance only 70 units away from the first. The center 
distance is only 30 units. Halving the tolerance has cut the operating 
range by 70%. 

The illustration only gives a tolerable condition for tool and 
mold wear situation. Each specific problem depends on the relation 
between the sigmas and the tolerance. 

4. Control Charts 

Much mention has been made of control charts, and Chart 21 
gives a typical chart. Its function is to help keep production on a 
steady keel by analyzing for trends and for causes of deviation not 
inherent in the process itself. 

The control chart, as such, does not show a specification limit. 
Specifications are for individuals - control charts deal in the 
averages of small samples. Some means must be provided to tie 
the two together. 


AN ACTUAL PRODUCTION CONTROL CHART 
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The several methods of doing this result in what is knowiji as 
"modified" control limits. Either the specification is changed (for 
■working purposes only) into a specificaHon fpy the average of the 
sample size, or a secondary line is placed on the control chi^rt 
giving a limiting position of the average Of the sample, just as for 
tool wear . In either event tMs is accomplished subtracting an 
amount from the specification maximnsn. or adding to the minimum 
Usually this is approximately the difference be|ween 3 sigma; of the 

population and 3 sigma of the average of the sample. 
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Fig. 22 

5 . Process Capability 

My last point is most important of all - the study of pr<^cess 

capability in relation to specification. It is so important th^t any 
kind of complete treatment is too inuch for this paper . Fundamentally^ 
it is a study of the several phases of variation in production; with the 
view of finding if it will meet specifications. It includes a |tudy of 
the following; 

Variation of the individual sampling. , 

Instrument error m 

Sampling error 
Inspector variation 

Variation of the product at any one mo|jnent of 
time. 

Variation of the product from one time of pro- 
duction to another time. .; 

Variation between multiple or parallel machines. 
Variation from one production run to another. 
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One method of handling this has become known as the SPAN 
capability method, which takes its initials from the words ’'Systematic 
Procedure for Attaining Necessary capability". It is a statistical 
procedure, not too complex, but definitely systematic which can be 
applied. (5) 

Many of you are possibly "lost", statistically, by this time, even 
though I have purposely avoided details, each of which would have 
been a discussion in itself. You may be inclined to "skip the whole 
idea". Such inertia is one of the problems of today - it leads to lack 
of understanding and to futile disagreement. Let me urge you to 
investigate the statistical method of "finding the facts before setting 
the specifications". Its use will save thousands of dollars of 
unnecessary loss - your money and others' money. 

Summing up this paper, the correctness of a specification is 
determined by the mathematical relationships between use and pro- 
duction, together with cost. Specifications fundamentally should be 
based on fact. The facts must be known first. They must come from 
a study of the product, of its use, and of its production. One of 
these three considerations alone, or any pair, is not enough. There- 
fore, correct specifications mean an open, cooperative effort by 
maker and consumer. Each must be conversant with the problems 
of the other and both must be willing to study the overall problem. 

Finally, "Specifications are not rubber bands - to be stretched 
when necessary, then a little wider, and a little wider, until the 
whole structure falls". 
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B^ATlBnCAL QUALXanr control IK AUTOMOTIVE STAMPING PRO|[7C^|P 

J. ItohAlak 
Tha Budd Cbnrpany 

Whan I took on tha task of datarmlnlng what was bain^ dona In 
tha application of ^Statlatlpal Quality Cbntrol In Automotfya Stamp-* 
Ing Produotlon** I knw how we contrpRad quality at Budd*a« I aXao 
knaw how it was dona In aoma of tha other automot lye manufacturing 
planta« but I did not know ahat the entire Induatryiae dolng. 

In the more than fifty yaara and thraa major confllota that 
the Automo t lye Industry haya axpeflahced^ they pro caaded tQ grow 
without any real major aatbacka, ao that today thay atand ^llactlTa- 
ly aa the large at alngla manufacturing Industry of a oonauiler pro- 
duct* It only atanda to reason that these conditions they 

must have good sound ay at ama of quality control* 

In studying these systems of quality control still referred to 
In the major portion of the Induatry as Hnapeetlon** « it w^s learned 
that In a number of cases a method ^had deyalopad that la peculiar to 
that induatry In the a tamping of automotiTa parts* This system, 
baaed on the thought of tha older school « that If a job ial 

(a) veil designed 

(b) Properly anglnaared 

(c) Cbrractly planned 

(d) Sattsfactdrlly constructed 

(a) And Initially ohackad and 0*K**d 

(f 1 Inspection Isn't necessary. 

It can be reMlly seen that this assentlally la a fom of con- 
trol * control of tha funotione th^ possibiy causa difficulties, 
thereby preventing such dlfflcuit lea* Although this did n^t alimtya 
work* It la surprising to see how often It did, and can be; cradltad 
with tha earUer a^octssei^^^ Industry where quality and produc- 

tion were ooncarnad. As with all industries, as tha product beoama 
inora opmplax and production problems more damandlhg, the sire tam^^^^^ 
quality control generated Into a system of Inapectlon and fe-work, 
and finally quality control with the uaa of racprda a^^^ 
although it la not referrad to In thla manner* ; 

Fifteen of the major automobile manufacturers and auibOTOtlva 
atanqg^lng plants ware contacted for Information in regard to ^alr 
application of Sitatlatleal Quality Cbntrol In automotlwa ejtasiplnga* 
Haturha ware recalled from aeyan* To avoid comparisons of althar 
tha response to tha questlonalra or methods of application, ho ref- 
aranea will be made to these companies to distinguish one from the 
other, than to list their namas for aaslstanca credit at t|9a and of 
tha paper. 

Tha Informetipn requested was as follows* 

1, Initial application - data 

£• Type of application - product 

3* Vhsthar application directly eontro lied press operations. 
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and/or product of same. 

4* Method of charting and control 

5. Raaulta and aunmary 

6. Gbpica of charts 

7. Picturaa of operations, if possihle 

Tea can readily see if there had been lOOji response what a beau- 
tiful statistical report could have been given on the subject. With- 
out it we will use the information received to give you some idea of 
what is being done and how. 

By turning the clock back a few years we can see Just how the 
present methods of quality control evolved. In going back, many names 
were encountered of those who had pioneered in the early applications 
of inspection and quality control in the automotive stamping field. 

Previous to the mid-thirties, detailed drawings on auto stamp- 
ings were accepted by the manufacturers and immediately used In mak- 
ing wood models which in turn were used in making dies, templates and 
other tools. These models were seldom checked by the Inspection De- 
partment. The result was that any error in the model became an error 
in the die or fixture built to that model, resulting in stampings 
that were wrong and would not assemble properly. About 1933 this was 
changed so that all models were checked by the Inspection Department 
before releasing for die or template building, or any other use. 

About the same time lists of complaints were published and dis- 
tributed to the shops, with hourly checks being made on the material 
coming off the lines to see if corrections were made. This was not 
exactly accepted by the production people with open arms, but when 
understood and results shown, they went along with the idea. This 
led to the next step - the '^Check Off System” which has proved quite 
satisfactory through the years, being continued in use today in an 
improved form. The "Check Off System” uses a form covering a major 
part, upon which is detailed all the important dimensions with pro- 
visions for indicating the condition of any particular dimension. 

These reports were then used in the acceptance or rejection of the 
material in question. They were then examined by the person in charge 
of inspection who would initiate the necessary action to correct the 
existing conditions. 

Although even today charts do not predominate in the automotive 
stamping operations, facts are so organized as to give the various 
key personnel (Managers, Superintendents, Chief Inspectors) a con- 
tinuous comprehensive picture of conditions and quality standards as 
they exist, in a manner to meet any requirements of the management. 
Statistics are compiled on acceptances, charges, costs, scrap, etc. 
being fed into automatic recording calculators and broken down in 
such manner as to be available for managerial purposes. 

To better appreciate the Quality Cbntrol Function of an Auto- 
motive Stamping Plant, one must understand the problems peculiar to 
this method of manufacture and the means used for its control. 

There are two distinct variables to be contended with in the 
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wBnafactwpe Pi Bt^apin^^ 

1* !!!he sudden change of quality which wculd he Illustrated . 
in a histpgraa hy a sudden shift pf^^t^^ 
to one side ex' the other# This ^ aid he caused hya hro- 
hen topi, such as puh'^t s^er edge of a 

Then there is the gradual change of quality that ipuld re- 
sult in the hroadening of the base of the hell curre 

of the histogram# This being due to normal wear of; the 
tools and would it would not he hot ice- 

able on any normal run and perhaps not eten during the life 
of the job# The enoeption being on heawy gauge automotiTe 
structurals such SS chisele |ra^ radii was^ut 

more rapidly due to the tremendous forces required :for form- 
ing these parts* One condition changes so rapidly and the 
other so .slowly that the .u.sual,.,.,,.8tati8tipcj^_methpjf^^^^ 

and **B" chart or even the chart can be of li^ttle use 
after an initial survey# 

This does not mean that there le no reliability program in 
effeot in press shops# ^e various oomimhies 

of approach to this problom# usually done on a saotpling baeia# One 
of the oooperatihg codflpanioe use a **Check Plf Sheet** for major etamp- 
inge and sub-aeeemblits and a beautiful and effective "Bar 

Chart" indicating a vary decided improvement in their product# 

We can uee the following as an exainpla of a reliability program 
that can be cons 1 dared as In general with outpmptlye stail^^^ 
plants# 

if ter die try-out and a detailaC^ piece inspection of the 
stamping resulting in acceptance and approval to start the rmx# per- 
iodic checks of the stamping are made at regular Intervals# This may 
be done with jigs and fixtures or just templates# depending pn the 
requirements# The inf promt ion by this check is reoi^dtdpn 

charts or check sheets (similar to those mentioned before# detailing 
ail the major dimensions) indioat ihg the progress of the Job# From 
past experience changes are so gradual that a rcui is usMil^ 
ed before any appreciable change takes place# In fact# a number of 
runs or the entire job may be oompleted withput any appreciaile change. 

Vhera there is an IndipatlLon.of trouble such as the constant 
breaking or wearing of punches or. the washing' of b 
be pinned down to a definite cycle# a study is made by charting tha 
time cycle to determine the best time fPr 

mise time lose due to maintenance# When poseible this change will be 
made during the nearest break period to the end of the cycle# so that 
there is no interference to production or reduction in the Sjlsndards 
of quality* Prior to this system# changes were only made after the 
creation of defective ma|erial# which entailed sorting cut of the de- 
fective parts and subsequent re-wprk#^^ T^^^^^ »i«pic control mlp the d 
eliminated the additional expense of time and manpower for oi^rreotive 
aotien# 

. ij . . . 

Ih#re #r# tlawa vha& an tnapsetlon oheok of the at«aqEil!ng may 
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not rereal some of the details of dlfflcttXtles to he enooontered in 
assemhXing* This may be due to stampings being made to opposite ex- 
tremes of toleranoe, metal spriagback or just the olose tolerances 
to which it is necessary to make the part. A 9 the Automobile Indus- 
try is built around mass production, idiich in turn requires esse of 
assembly, considerable concern is shown when this condition takes 
place. 


To cope with this situation the automobile stamping industry 
have designed special inspection and cheeking fixtures. These at 
times become very complicated and may accomodate the parts for an 
entire body or chassis in such manner that the parts can be checked 
in their relatiye ear positions. This also simulates assembly oper- 
ations and prores the assembly of the parts. Again your "Check 
Sheet" comes into play to record the result of an inspection check. 
These inspection checks are made at regular intervals, the results 
being recorded and plotted to indicate any trends. Ihen there are 
indications toward deviations, that if permitted to continue would be 
cause for rejection or cause difficulty in assembly, corrective action 
is taken. These corrections are usually made during a down period to 
keep production losses to a minimum, which makes it so vital to be 
able to anticipate any possible deviations, ‘^en a sudden deviation 
takes place, due to a tool breakdown, immediate action is necessary 
to correct the condition* If this is not possible, these parts are 
put aside and corrected* Tou can rest assured that this isn't per- 
mitted to happen very often, as it would greatly increase the cost of 
the product. These controls are very effective in keeping such in- 
cidents to a minimum* 

When one stops to consider the number of mating parts and match- 
ing holes that in turn must be matched or mated with parts possibly 
from other sources of supply, such as other shops or companies . your 
quality control must be good. This ability to accomplish this con- 
trol was not attained by simple inspection procedures, but by the 
use of endless records, otherwise called statistics. Accumulating 
and organising these facts to realize the potentialities of a manu- 
facturing process, to know how close these parts may be held* Natur- 
ally. this being done not alone by quality control, but with the aid 
of Bnglneering Planning. Tooling and last but not least, the Press 
3hop Personnel. To realize the effectiveness of this program one 
only has to look back a few years when the permissable tolerance in 
stampings was l/3S" and sometimes more* Today it isn't rare t 0 have 
these tolerances held to l/64" and even less* 

The quality control of automotive stampings does not end in the 
press shop but carries on to the assembly floor sdiere a very close 
surveillance is kept over the condition of stampings in relation to 
their ease of assembly* Reports on assembly conditions giving diffi- 
culty are directed back to the press shop, where the tools are care- 
fully re-checked and the parts are again checked to the piece drawing. 
When the tools and the parts check satisfactorily and there is no ex- 
planation fob the trouble in assembly. Engineering is called into the 
picture to make a study of the problem, effecting an engineering 
change, should it be necessary, to correct the difficulty. 

The problems of the quality control function in assembly differ 


86 



a graat daal from of press shop* 1 % is in assembly vliare 

the most jprh has been done in the statistical q^uality control field* 
With the large number of manual operations in assembling, such as 
neldlng and finishing, the necessity for non«*des tr act lye te| ting, and 
the checking of such intangibles as isetal finish, have provided a 
fertile field for sampling techniques, controi charts, quality rating 
factors and pther^^^^d^^^^ permitting the use of pyschologiciil and vis 
ual aides* ^ey have in most cases proved satisfactory as indicated 
by the papers and publicity covering the subject, but this is another 
story and should be handled as a separate presentation* 

Summarizing this paper on the application of Statistical Qual* 
ity Cbntrol In Autoin>tlve Stamping Production, let us see what we 
have* 

Generally speaking, statistics are used In the appllcati on of 
quality control In press shops, but ziot in the sen.se, as stati stieal 
quality control people recognize these applications* 

Ws may ask ourselves shy? 

Qan it be that the potential of application is limited due tot 

1 * Material control handled by o ther than the Press .Shop , 
such as, the laboratory or receiving Inspection* 

2* Tools, nature of them reduces variables to a minimum, 
requiring little attention after initial check and 
acceptance; wear being negligible in the narmar^^^h^ 
cation of those tools* 

3 , inspection Obntrols 

(a) detailed initial Inspection providing fof 
Initial close control, assuring satlsfacr 
tory tooling* 

(b) Periodic sampling, with use of intricate 
gauges and fixturea, simulating end use 
of the product, plus report of results* 

(c) Liaison system between press shop and 
assembly floor, assuring satisfactory 
application of the parts* 

Gan we say that Management has not been sold in the ^|i|a 
Statistical Quality Control in press shops, when we know its use has 
been adopted In assembly operations and has been used on occasion. 

In the production of stampings* 

These questions and others can probably be best anii#red by 
you, particularly those of you who have a direct assoc latidn with 
automotive press shop operations* 
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QUAMTi omnoi w XRE m co/im) magp^: 

W« £• Braner 

John A« Ro6bling*s Sons Corporation 

Before we begin to discuss the use of Qaality Control Techniques in 
the iiianufaoture of FiM Cpa^^^^ Wire let ue take a few j|inutes to 

look at the product in general# The Electronic Industry and the motor 
and transf priner ixid^tf progaressed so fast, during the past de- 
cade, that tl^ quality requirements for this Magnet Wire are how far in 
excess of those necessary a few years ago# For exaBqp>le - the manur 
facturer in these fields is required to wind many turns of magnet wire 

iito a highly restricted, ays* 'lie'.^.,.^.yan dla||e,te|,,^,.^|B^^^ 

inherent size variability of the wire become increasingiy impbrtut. 
Again, the manufacturer is continu^^ required to produce smaller and 
smaller equipBient and still keep his quality ratings at the simie level# 
His ability to do this depends largely on his ability to obtain high 
dielectric strength magnet wire; in fact, for this particular end use, 
a wire with a dielectric strength far in excess of specification re- 
quirements of a few years ago is a prerequisite. 

In order to produce a finished product with a quality leyel well in 
excess of general si)ecification requirements, It is necessayy^' to stard> 
with the raw material and to octroi the processes carefully at each 
manufacturing point, as the transition from incoming raw material to 
outgoing finished material progresses. 

One of our first applications of Statistical Quality CohWol Tech- 
niques at John A. Roebllng*s Sons Corporation was to control |he j[^ 
facture of Hot Rolled Copper Rods. This control was established a^ut 
ten years ago and has since been extended to cover the entire, manu- 
facture of Magnet Wire. We are happy to he able to share our^ experi- 
ences In this f^^^ wii^ you# 

The raw material from which Wire is wade first enters oii^ 

plant in the form of /‘Copper Wire Bar”, which is purchased ftom 
several reputable copper refineries, and is subjected to a routine 
visual inspection before being released for production* The popper 
wire ^r is loaded on special cemveyors and delivered to the '”1104 Mill” 
where it is hot rolled into ”C6pper Rods‘V of the required diameter 
(usually 5/l6” or 3/8”) in coils of 2 J 4 ” I.D#, weighing about 2^ lbs# 
each* Upon delivery to the ”Wire Mill” these coils are f^^^ cleaned 
in a sulphuric acid solution to rempye aU scale and t!^n dipped in a 
soap solution to aid in the wire drawing operation. 
is first shaved, to remove any surface imperfections, then c4|ld drawn 
to the required size (annealing in process If required) and Uent to the 
Enamel Shop where it is covered with successive coats of enamel or 
varnish as the ordey may specify and placed on reels, spools^' or in 
drums for shipment. 

So much for a general review of the manufaoturizig process. Now 
let us review it more slowly and see how Quality Control Techniques 
help, at strategic processing spots, to produce a finished material 
that surpasses specification requirements. : 

INCCKENG INSPECTigS - The incq^ inspection of the Co]|^r Wire 
Bar is quite routine. The bars are examined v^ for surface 
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imperfections and pouring defects ^ particularly high rolled edges that 
would be injurious to the rod surface after hot rolling. Records are 
kept and the Quality Le’vel of the hot rolled rods produced from wire bar 
from the various refineries are coBipared with the incoming inspection 
findings. 

ROD MILL - The transition from copper wire bar to hot rolled 
copper rods is accomplished by heating the copper wire bar to approxi- 
mately 1700^ in a long furnace^ under a reducing atmosphere^ and then 
hot rolling it through a number of rolling passes. This operation 
reduces it in cross section and elongates it in length by a series of 
oval^ diajBondj and square shaped passes to the final round rolling pass^ 
called the finishing pass^ which produces the hot rolled rod of the size 
required. 

For a number of years prior to the introduction of Quality Control 
Techniques into our Rod Hill we used an inspection procedure whereby 
we took samples frcwn each of the four finishing reels at specified 
intervals^ and after twisting and examining the samples^ graded them 
into class one^ two^ or three depending on the number and degree of 
imperfections noted. An attempt was made to use only class one rods 
for Magnet Wia^e end use, class two for high grade strands and fine wire, 
and to divert class three rods into line wire or other non-critical end 
uses. 


In 19148 the amount of class three rod produced began to increase 
alarmingly and by June of that year was averaging nearly About 

that time we were becoming seriously interested in starting a Quality 
Control program but did not know just where to begin. The Rot Rolled 
Rod situation was becoming quite serious, so; that became the starting 
point. 


Using dead data, and for the moment calling class three rods de- 
fective material, we worked out a Percent Defective Chart on a daily 
basis and established control limits around the monthly average of the 
daily percent defective. We fully realized that we were taking cer- 
tain liberties with pure statistics, in as much as the daily lot sizes 
were different and we were ignoring this difference. Our main purpose 
was the correction of a bad situation and from this simple beginning 
we have learned that the simplest approach, not always statistically 
pure but at least understood by the rank and file, often pays the 
highest quality dividend. Our next step was to discuss this chart 
thoroughly with the operating personnel in the Rod Mill and to erect 
a large control chart, which was posted daily, where everyone connected 
with the Rod Mill could see it. Daily percent defectives which were 
within the control limits established from the oi)eration of the previous 
month were posted in green. Percent defectives falling above the 
upper control limit were posted in red and those below the lower control 
limit were posted in yellow. As regards to the use of the chart, the 
operating personnel were requested to do only three things. First, if 
the daily percent defective fell within the established control limits, 
regardless of the level, they were to continue operations with no 
chaaiges. Second, if the daily percent defective fell above the upper 
control limit, they were to do all in their power to locate the cause 
of the trouble and to correct it. Third, if the daily percent de- 
fective fell below the lower control limit, they were to attempt to 
determine the reason for the exceptionally good run and to make such 
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processing changes as might be necessary to taice advantage of it in the 
future. They were assured that if this plan was followed faitk^t^ly 
the percent defective would be lowered each mcmth iptil it rea^i^d a 
state of cqutrol which would represent the inherent quality le^l of 
that particular mill and operators. By October the percent defective 
had dropped to and later to about 2-1/2^ where it hai j^ 
a result of this^ the quality level of the mill was raised to tine point 
that It was no longer necessary to segregate the rods for various end 
uses. The entire personnel in the Rod Mill became very quality 
conscious j^ othfr i^ units^ which had been following the 

procedure with interest, began to request Quality Control programs of 
their own. 

WIHB MIhl - There are, of course, many problems which present them* 
selves in a wire mill* If we concentrate on Magnet Wire we fi^ that 
the surface and gauge of the finished wire are both of prime importance. 
Assuming good wire mill practice, the surface is Isurgely dependent on 
the quality of the hot rolled rods from, we 

. have already seen how Quality Control ca£’'^te’Vsedrtoradv^ 
the quality level of this product at a high level. The diiaeter or 
gauge of the finished wire is important and we wduld like 

to share with you our experiences in the use of r^ry simple Qu^ity 
Control techniques to control the diameter of this w^ within limits 
more restrictive than specif icateon requirements. 

We were well aware ttet, Wire, were 

desirous of obtaining a wire with a closer ga^e tolerance than general 
product specification limits. We were also alert to the econcj^c fact 
that when a product which is sold by the foot, is made from raV material 
which is purchased by the pound, it is to the manufacturer's fteanctel 
advantage to produce as many feet of finished product per pouxp of rawr 
material as possible. While this does not pertain to Magnet kfire it 
is true of many products in the tesulated conduct^ field, and all 
producers realite tet adv^ to be had in holding the gauge of iir- 
dividual wires and strands as close to specification minimum as 
possible, without suffering costly rejections by violating these 
minimum requirements. 

The question was asked times in OUT organization, ''Can we 

produce a copper wire with oriy one half the yarlatiop |n 

that allowed by industry specifications?*' Some answered this.^ question 
in the affirmative end some te tee but all w’ere guessii^ to 

a large extent* Their answers were bssed qn their ixidividual. opinions 
of what could be done, but were not founded on the facts of tpe case. 

Our second step in this particular Quality Control progrjEan was to 
determine just how close t)te dia|||ter^^^ wire could 

be held, using the pste sent equipment, without u^ 
manufacturing cost* 

A process capability study was made on a small group of four wire- 
drawing machines, drawing finished wire, to determine tee degree of 
variability inherent in the process as regards to the gauge of the wire 
produced. As in the case of the Rod Mil teis was done ucinf the 
silkiest of Quality Control techniques — in this case tee average and 
range chart. Our approach was to take a sample of wire from each of 
tee four machines at regular intervals, gauge the samples, aterage the 
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diameters, and plot the average and range on a control chart* In a 
relatively short time it was learned that the equipment was entirely 
capable of producing wire within industry specification limits, but was 
incapable of holding it to one half of these tolerances* We extended 
oiar experimental work and studied samples taken from individual machines 
in the group, instead of from the group as a whole, and found that while 
some machines were capable of maintaining the desired tolerance, others 
were not* In addition, we were quite surprised to learn that one of the 
machines was producing wire which was not entirely within current 
specification limits and was responsible for some of the finished wire 
rejections we had been experiencing. 

From this short and Inexpensive study it was learned that: 1. The 
present process, assuming a slight modification on the one machine, was 
capable of maintaining industry tolerances; 2* The present process was 
not capable of producing wire to the doubly restrictive tolerance 
desired; and 3. There was a good indication that if further investiga- 
tion was made and additional expense incurred in refining the process 
it would' be quite probable that these restrictive tolerances could be 
maintained. 

Following this process capability study a meeting was held at which 
it was decided to modify the process slightly and to hold the total 
product within the lower three quarters of the existing specification* 
Average and range charts were immediately set up on this product and 
we began producing wire with an average diameter in the lower half of 
the existing specifications and the upper and lower controls set so that 
no wire would fall below the minimum specificatjon and only a very small 
percentage would fall above the commercial specification nominal* 

The decision made at that meeting was based on fact, not someones 
opinion, and was proven by the uniformity of the product produced frcsn 
that time on* As a result of this, we have not only lowered manur- 
facturing costs, by reducing rejects and obtaining more conductor 
footage per pound of copper on many items, but at the same time have 
supplied our Magnet Wii*e customers with a product which is siore 
completely designed to their special requirements. 

Thus far in pur discussion, all that has been discussed could well 
be said about copper wire in general, drawn for any end use. The 
material destined for the Enamel Shop is finished on reels or spools of 
appropriate size. These spools or reels are paper wrapped and packed 
on skids for delivery to the next and final processing operation* 

ENAMEL SHOP - Let us take a few moments to look at a typical Enamel 
Shop operation* Basically the main pui'pose of the process is to apply 
a thin, smooth film of insulating varnish or enamel, as the case may be, 
to the surface of the copper wire. Normally the dielectric strength is 
proportionate to the thickness of film and both are of vital importance 
to the user. The insulating film is applied by repeated passes of the 
wire thru a varnish applicator. Dies control the thickness of the 
coating. The coated conductor passes thru the baking oven where the 
enamel or varnish is thoroughly cured and returns to the applicator for 
the required number of successive coats. 

There are three basic sizes of equipment which we have in general 
use today to cover the wide field of sizes used. We refer to the large 
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enasne Xing machine and baking oven, generally known as the Machine”, 
which normally handles sizes ranging from #8 to #23 A.W.G. We next 
have the intermediate group, known as the Machines”, handling sizes 
from #23 to #32 A*W.G. and also the fine wire group, better khoia^ 
the ”F Machines”, which are capable of handling sizes from #32 to #hi; 
A*W.G. The basic operation of the three t^chipe groups is the same, 
consisting of alternating cycles of coating and M The ”M” and the 

”1” machines operate vertically, and the thickness of film is controlled 
by sizing dies* The ”P” machines operate hpriz<^tally and the thickness 
of film is controlled by a rotating rod which has been grooved to per- 
mit the proper amount of varnish to flew on the wire, and by a close 
control of of the enamel or varnish* The ”M” and ”1” 

type machines are equipped with a high temperature, neutral atrnosphere, 
annealing chamber which softens t^ to the coating cycle, 

whereas; the type machine deij^nds sblel^^ in the baking 

oven for the spftenipe effect. 

In connection with in the manufacture of film 

Coated Ma^et Wire there are several very important characteristics 
which must be watched carefully and controlled within close limits. 
Statistical Quality Control has proven to be pf great value ih^ main- 
taining the quality level of this product on a high standard. 

The vitally important characteristics of l^net Wii*e fall into two 
categories: vis, Hjysical and Elec tricai, 

PHYSICAL CHARAqTERISTICS 

1, Gauge 

a. Conductor size - generally referred to as the ba^ 

diameter, is vitally important* Too small a conductor 
size may be responsible fpr high rejections on tl^e part 
of the coil vinderf due to high electrical resis^^cej 
and conversely, if the diameter of the conductor .is op the 
high side of the size tolerance the coil winder not 
be able to wind the required number of turns of liire into 
the highly restricted space allowed him by the coil 
designer or user. 

b* Thickness of film - poiyiaXly referred to as Insulation 
buildup, is also vitally important, A wire with minimuift 
insulation buildup may well meet general industry 
specification, but a coil wpvaid from this fail 

under an electrical surge test applied tq the 

finished coil or motor. On the other hand too high an 
insulation buildup may render it impossible for |he coil 
winder to hold his finish^^ product within required size 
restrictions* 

c. Overall Diameter — corrmionly referred to as 0,D,, is equally 
important as it is a combination of the aboyeme^ 
dimensions and is of vital importance to the coij. winder 
in maintaining finished coii dimensions within s^Lze 
restrictions* 

2* Softness - We all recognize copper to be one of the softer 

metals. Strangely enough the degree of softness plai^ a very 
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importarit part in the use of magnet wire in coil winding* The 
coils produced by the coil winder are not all round and 
cylindrical. Some are square and some rectangle. Some are 
wound as skeins, similar to yam, and then positioned into 
coils. Some are quite sharp at the corners and some are 
nicely rounded. All this variability in coil size and shape 
imposes a definite degree-of— softness requirement on the wire 
from which the coil is made. The magnet wire must be soft 
enough to conform closely to the core, or basic shape of the 
coil, under many varying winding conditions of speed and ten- 
sion. It must be capable of withstanding bending at high speed 
around sharp angles and stay put with little or no spring back, 
for as it can be readily seen , the accumulated spring back 
from numerous layers of coil winding would result in mushy, 
oversized coils unsuitable for their required end use. On the 
other hand, if the magnet wire is too soft, any unusual in- 
crease in the winding tension dxaring coil winding will place 
the wire under a strain greater than the elastic limit of the 
wire and the diameter may be reduced, pulled down as we call 
it in the mill, to a point where the electrical resistance of 
the finished coil may be raised beyond specification limits. 
Modern high speed winding equipment has imposed more critical 
demands on the magnet wire producer in the past few years than 
ever before. These machines are extremely intricate and pass 
the wire over numerous small sheaves and guides to the coiling 
head thus requiring a uniformly soft and well spooled wire for 
efficient operation. Most users of magnet wire stress their 
requirement for extremely soft wire, however the manxifacturer 
who knows his product, and is conversant with the use to which 
it will be put, will produce a wire that is neither too hard 
nor too soft, but just right for the individual customers end 
use, 

EI£CTRICAL CHARACTERISTICS 

1. Dielectric Strength - The ability of the insulating film on the 
magnet wire to withstand voltages far above specification re- 
quirements, in the form of surge voltages, is highly impor- 
tant to the coil winder. All other things being equal the 
dielectric strength is in proportion to the thickness of in- 
sula, ting film. We have already learned of the importance of 
the space factor which makes it advisable to hold diameter 

and film thickness to a minimum j therefore, the processing 
must be adequately controlled so that the maximum dielectric 
strength is maintained with a minimum film thickness, 

2, Continuity - The complete envelopment of the wire by the in- 
sulating film, with no pinholes, voids, cracks or openings 
which might cause an electrical short in the finished product, 
is of vital importance to the coil winder. Industry speci- 
fications allow a maximum of 15 pinholes or discontinuities 
per one hundred feet of length. If the manufacture is to enjoy 
a carefree existence, if such is possible, the process must so 
be controlled that the coil winder will receive material with 

a minimum of discontinuities throughout the entire length. 

The requirements of the industry specifications referred to thus 

far lend themselves nicely to Statistical Quality Control Techniques and 
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we have profited greatly from their use . There are also mechanical, 
thermal and chemical requiremeriits of the specification, such as tests 
for solubility, aging, adhesion, etc., which do not lend themselye^ 
readily to these techniques. These characteristics are dependent on 
the raw materials used and on the basic manufacturing process. 
the raw material and the process standard are established and arp 
compatible, there is little variability encountered and the process, 
in this respect, can be controlled by small sample sizes taken at 
extended intervals . 

In setting up a Quality Control program in the JEnamel Shop the 
first problem was to work out a suitable sampling plan. As it is 
frequently necessary to run more than one size on 
the unit lot, for sampling purposes, was designated as a particular 
size mmning on a given machine during a specified period of time. The 
plan decided upon was to take four samples from every machine ih 
operation and if there MS more than pne^^ of magnet wire 

running on a particular machine, four samples were taken from each 
different size or grade. The samples were taken at specified ttoe 
intervals, by the process inspectors working on the floor, and iirere sent 
to the tester working in the control laboratory. Upon receiving the 
samples the testers x^sponsibility is to test all samples receiyed for; 

1. Gauge 

a. Overall diameter 

b. Bare copper diameter 

c. Insulation buildup (by subtraction) 

2. Softness 

3* Dielectric Strength 

i*. Continuity (if size requires) 

The results of these tests are thpn^^^^^^^^^ and plotted statist 

tlcally, on simple average and range charts, and the results ar| made 
available immediately to the Production Department to enable them to 
control the process satisfacto^^ily* An individual control cfearfi is 
kept for each size and grade of wire manafacturs4 and, although a 
particular size has not been made for some tir^ the previous chart will 
be removed from the file, and added to, when that size next apj^ars on 
the production schedule. In this manner we have a cpnti^upus qpalit^^ 
record of all wire manufactured, by size and grade, showing the quality 
level of each manufacticring run with relation to any other run of like 
material and also a record of t^^ level from day to day withan 

any production run. As the date of mani^apture^^ a on all Creels, 

spools and shipping containers it is possible to check the quality 
level at which the particular item was produced, even after delivery to 
a warehouse or customers plant. In addition to the testing referred 
to above for control chart purposes, the samples are checked further 
for complete compliance with industry requirements such as aging, 
solubility, adhesion, etc., at the start of each production ruri and also 
at a designated time on a weekly basis. 

In this discussion we have elaborated only on that phase of the 
inspection activity in the manufacturing process which deals w|th 
statistical quality control. In addition to obtaining saimples for the 
statistical control of the product our process inspectors are Constantly 
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circulating around the production department and are continually 
checking the product as it is being produced* Our regular inspection 
organization consists of Process Inspectors, who have the responsi- 
bility of checking the product during manufacture, and Finished Goods 
Inspectors, who are located at strategic shipping points and are 
charged with the responsibility of checking the product immediately 
prior to shipment to a customer or to another division of the Roebling 
Corporation* These Process and Finished Goods Inspectors, paid on a 
weekly salary basis and represented by a white collar local of the 
United Steelworkers of America - CIO, report to their respective 
Divisional Head Inspector, who is a management representative under the 
direction of the Chief Inspector* The entire Inspection Department 
reports through the Chief Inspector to the Vice President in charge of 
Engineering and is thus completely divorced from the Production 
Division* 

In connection with the production and end use of magnet wire and 
related products we have also used quality control techniques to good 
advantage in making an extensive comparative study of the product 
supplied by the various manufacturers of magnet wire to the general 
trade. This study covered a wide range of sizes in both enamel coated 
and TJarnished magnet wire as produced by many different manufacturers. 
The studies showed clearly the quality level being maintained by the 
various suppliers and indicated that the larger manufacturers were all 
conversaint with the high quality requirements of the Magnet Wire user. 
Studies were made on bare wire diameter and overall diameter, 
dielectric strength, continuity and softness. The studies were very 
interesting in that they showed clearly that all major manufacturers 
were attempting to hold their product on the low side of the size 
tolerance and that all (with varying degrees of success, to be sure) 
were attempting to exceed industry specification requirements as re- 
gards to dielectric strength and continuity. The study on softness 
was particularly interesting in that it verified, to a great extent, 
the general comments made by many end users of magnet wire regarding 
the softness of the wire produced by various suppliers. 

Quality Control techniques have been a big help to us not only in 
holding our quality of product at a high level, but have also improved 
our relationship with many of our customers. 

Let me share with you an experience we had a short time ago which 
proved the value of our quality control program and improved, to a 
great extent, our relations with ovr cuvStomer, One particular morning 
we received a phone call, from one of our larger users of magnet wire, 
advising us of a serious problem that had been referred to them by one 
of their customers. It seemed that certain motors were shorting-out 
in service and indications at the time pointed to the use of defective 
magnet wire as the cause of the trouble. The trouble had not been 
traced to the use of our particular magnet wire but our customer wanted 
us to be alert to the situation. At the time the phone call was re- 
ceived there were several large lots of material in our Shipping 
Department scheduled to be shipped that afternoon to this same 
customer* The questions uppermost in our thought were: "Shall we 
ship?" or, "Shall we hold and re inspect?" V/e reviewed our quality 
control records and charts for the period during which the material 
in question had been made and found it to be eoual to our usual high 
standard. On the basis of this we released that material for shipment 
with no further Inspection. We also visited our customer, advised him 
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of our decision, and showed him the data and the control chart ^ 

Ve had based our decision. We further advised that while we di<| not 
believe our material to be the cause of their trouble we would ije very 
willing to work with them in their plant or in our own, oh their pro- 
cessing or on our own material, until the cause of the trquble^^^^h^^ 
located and eliminated. The customer was able to locate the cause of 
the trouble and eliminate it promptly and our wire was in no way in- 
volved in the problem. This is just one more proof of the ability of 
simple quality control techniques to save money, to maintain quality 
standards, and to cement human relations. Under such control, decisions 
which have to be made are based on proven facts and not on mere’; opinion. 

The use of Quality Control Techniques has done much to help us in 
the manufacture of a high quality magnet wire. This statement 1$ not 
based on mere opinion, it can be substantiated by the following basic 
facts: 

1. It has raised the quality level of the product we are manur 
facturing. 

2. It has reduced the number of complaints received from customers 

to an extremely low number. ■ 

3» It has reduced the cost of complaints per sales dollar^ to an 
extremely low figure. 

b. It has improved supplier-customer relations, 

5. It has saved cur company money. 

In short, we believe that the use of simple Quality Control Tech- 
niques, as we have applied them to the manufacture of magnet wire, is 
as necessary to the production of a good product as good raw material, 
good machines and good operators. 

The three H*s - good material, good machines and good manpower- 
plus a good Quality Control program are necessary for the efficient 
operation of any process at a high qtiality level. 
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ftUAim COHTROL IN THE MAITOFACTURE OF EliBCTRICAL acSTEMS 

W . Prank Lyrm 
Ford Motor Company 

The electric power plant heneath the hood of the modem automoMle^^ 
is a reiiraTlfiahie piece of eqiaipmeht/ a steady supply of 

electric energy, delivers it where it is needed, and stores it yor futuze 
use V . ■ " ■ 

Without this power plant, in fact, the modern car would not be pos- 
sible. We would still be^^^^c^^ the engine by Ksuid . Lights wo be 

produced by oil or gas lamps. Radios, heaters, air conditiQninjg, power 
steering and the many other useful accesspries which 

pleasure, comfort and safety would be unheard of. Modem transjpoftaiion, 
with its tremendous impact on bur national economy, would still be a far- 
off dream . 

Perhaps it is a little presumptuous to give so much credit to the 
electrical system in the progress the autcmipbile^^^^M^ Mie, but the fact 
remains that the electrical system is the nerve center without ^w^^ch 
nothing else will function. 

We who are in the business of maniSracturi^ the parts and assemblies 
which go to make up this nerve center thus carry a big responsibility. 
These parts must be dependable . They must stShd years of hard :use — 
even abuse and neglect — without letting our customer down. 1?lmt mes^^ 
quality must be closely controlled from beginning to end. 

Over the years that Quality Control has been earning its place in 
American industry, the control of quality in the manufacturing processes 
has usually received the lipnVs share of attention — and perhaps ri^tly 
so. But in pin* eame^^^^ attempts to keep our manufacturing errors frcii 
going out the door, throu^ rigid process and end item inspection, we may 
have pyerlopked sometblng very important. 

We|ve all heard it said, time and again, "Quality can*t be inspected 
into a product — it must be built ini" 

That *s only part of the story. Quality canH be built into a prod- 
uct unless it has been designed in. That*s the point some of ns have 
oveflppked. That's where quality must begin — on the designer's draft- 
ing b^3?d. And our responsibility for it cannot eiad until the finished 
product is in the custcpersi JmM 

Some of you may feel that design matters have little to dp with 
function in Quality Control — that we should leave that to ttie engineer - 
I feel very strongly that we have a vital interest in proper 4es£^, and 
that we should make pur voices heard at every opportunity. We must get 
across to our designers the interdependence that exists betwen their 
job and ours. The finest and most brillia^ conceived design is use- 
less until translated into physical reality. We caimbt make tl?ai,trans- 
latlpn efficiently unless the designer has taken into full consideration 
the llmitetions^^^^^^^ upon us by manufacturing processes and. by compe- 
tition. 

Actually, for the most part we have a good working relationship with 
our engineers. The tie between designed quality and manufacti^d quality 
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seems to "be growing a little stronger every year * You might say that the 
engagement has “been announced^ hut the marriage has not yet been consum- 
mated. So it is a little early to tell just what issue will come from 
this union. 

I want to explore this subject of designed quality more fully a lit- 
tle later on; but now let's go to the other side of the picture, to the 
job of building the quality that the engineers have designed into our 
products . 

In the Accessory Division of the Ford Motor Ccanpany we manufacture 
the principal equipment which goes into the electrical systems of our 
automotive products (One major exception is the battery.). In this Divi- 
sion we make the bulk of this equipment, including the voltage regulator, 
generator, starter motor, ignition coil, distributor and horn. In this 
discussion we will therefore concentrate on some of the quality control 
techniques applied at our Ypsilanti Plant . 

We are vitally concerned, of course, with a close control of quality 
at the receiving docks. But our receiving inspection techniques are 
probably not appreciably different from those in other industries, and 
there is little point in dwelling on them at any length. We have de- 
parted from the Military Standard sampling plans in some cases, and have 
developed our own Ford plan, which requires a smaller sample number than 
the Military Standard. We feel, and results bear us out, that it gives 
us adequate protection for our requirements, at a lower manpower cost. 

We keep the normal receiving records for each vendor so that we can 
tell at a glance how each one stacks up quality-wise over any given peri- 
od of time . 

Our floor and in-process inspection at Ypsilanti is limited to those 
items which the production operator cannot check, or which would take too 
much of his time. Where it is possible, the production operator is given 
the necessary tools or gages to do the job, and time for checking is 
allowed in the work standard for the operation. This puts a major re- 
sponsibility for quality parts where it belongs — on the operator. Spot 
checks are taken by floor inspectors on in-process items according to 
predetermined cycles and sizes. These checks are taken often enough to 
give assinrance that assemblies will go together. The sample taken for a 
spot check may vary between five and fifty pieces, depending upon the 
part or assembly concerned. 

This dependence upon production checking for so much of the actual 
in-process inspection may seem to indicate that Quality Control has abdi- 
cated some of its obligation and responsibility. Actually, we find the 
reverse is true . Production checking tends to create a greater quality- 
consciousness on the part of production operators, and it reseives to 
Quality Control the analytical and statistical functions, where we feel 
that its efforts should be concentrated. 

The end item sampling at Ypsilanti is concerned primarily with 
function and performance, and in some cases with appearance. I will en- 
large on seme of the phases of this important part of oinr program later. 

All other operations within the Quality Control Department are aimed 
at helping the shop inspector. The Statistical Analysis Section develops 
Inspection Instmction Sheets for each part or assembly so that there 
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will "be a consistent inspection pattern to follow v Data a.3re 

filled out by the inspectors are returned to the statistical section for 
analysis of the trouble spots . 

The Gage Section hrodles inspection of initial samples of purchased 
parts ; and checks machine setups to make sure they are correct fefore a 
production run is started. 

There are certain checks pertaining to the life and perforiaance of 
electrical equipment that take time to complete^^^ and thus can not be a 
^rt of the nprml end ii^ i^ This duty falls to thel Physical 

laboratory. The laboratory also analyzes field returns ^ ^ metos of 
these various iests and a the laboratory may develop information 

concerning field pei^ormance that will be futvire prolduction. 

Despite ell the in-process controls we may wish to install, it is an 
inherent trsiit of the mass production system that it will invariably have 
short periods of producing sub- siandard quality and some of tl^t produc- 
tion may be passed on to the customiprv^^ periods can spell 

trouble unloss you are governed by an adequate end-item samplii^ tech- 
nique. This is particularly true in the of electrlca^^^^^^ 

motive equipment ♦ A good deal of our Quality Control effort in oiir 
Ypsilaiiti Plant as well as throu^out our Division ^^h^^ concen- 

trated on our end-item sampling program in order that we may successfully 
fulfill our obligation to our customeirs. , . 

With the aid of seyeral^^^^^^^ I would like to describe ^ow the 

general system functions. 

Slide lA - Introduction to Our Reporting System 

These forms represent the backbone of our auditing system,. The 
first, the Inspection Instinaction Sheet, establishes the acceptable 
quality level (A.Q.L.) and outlines the inspector's duties. The second, 
the Quality Control Work Sheet, affords him a rapid method of recording 
his data. The third, the Outgoing Quality Trend Chart, is a simple and 
graphic method of reporting and evaluating the quality level to m^^ 

ment and to the customer. 

' ■■■ . . .. .... , . .... ■ . ■ 

Let ' s look at each of these forms iMiyidually . 

Slide 2 - Inspection Instruction Sheet (Form 732 ) 

This form is directed at the inspector. It supplies him ■^th the 
necessary information required to operate his station by listijog what be 
must check and iJd.th >^^ It lists the charajCteri sties and tt^e 

gage requirements as well as the quality level and frequency of inspec- 
tion. 

The plant Quality Control analyst originates this form* ^ evalu- 
ates the product and establishes the quality standard which must be main- 
tained to produce an acceptable end item* We attempt to do this in con- 
junction with the customer prior to production. In our case, the custom- 
er is one of ovur OTO^C^ However, more often than not, we 

must originate iiie entire form and establish the quality level, and then 
at a later date arrive at a M to chsxaoteriftics to be 

sampled and quality level to be maintained. 

In general, this last method is npt too great a handicap. We have 
found over a period pf time that the discrepancies, if any, are minor in 
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nature and are usually a matter of interpreting a specification which may 
not he clear-cut; for instance, how much burr may he allowed, what is 
flat, how sharp is a sharp comer, and so forth. 

Slide 3 - Work Sheet (Form PE!M-7337) 

After furnishing the inspector with a method of inspection, we then 
give him a rapid system of recording the data. The numbers on this sheet 
correspond to the chamcteri sties on the Form 732 so that a quick dash 
mark denotes the occuirence of a defect. Through a simple tabulation he 
may quickly render a decision as to accepting or rejecting the lot. 

At the end of each work shift these sheets are given to the Quality 
Control analyst assigned to the product. From these he may calciilate the 
process average of the end item, or of each individiial characteristic 
sampled . 

Slide k - Outgoing Quality Trend Chart 

This represents the culmination of our reporting system. It is a 
simple graphic presentation of the history of quality by which persons on 
management level may interpret quality trends of the individual products. 

At the end of each work week the analyst computes the data as re- 
corded on the work sheet. It is then duplicated and copies are sent to 
all management personnel directly concerned with the quality of the par- 
ticular product. 

Summary of Slides 2, 3 and 4 

Once again, let us briefly review. 

Step #1 - Instruction Sheet, sets the quality level and spells out 
the inspector's duties. 

Step #2 - Work Sheet, provides a method for the inspector to record 
the data. 

Step #3 - Trend Chart, provides a reporting and evaluating method 
for Management and, in some cases, the customer. 

This same system, with sli^t modifications, is used in our receiv- 
ing inspection area. 


In our attempt to develop a standard end-item sampling procedure to 
which the entire Division could conform, we found that we could not set 
one pattern for the actual inspection method. For example, let's take 
the generator, which you might say is the heart of your car's electrical 
system . 

Inspection Instructions for the generator assembly list seventeen 
different characteristics that must be checked by the end item inspector 
Of these, the most vital characteristic is the electrical output. This 
is of such primary importance that it must be checked lOO^i in process. 
This is done by production fixtures which merely indicate by green and 
red li^ts that the unit is either satisfactory or below specification. 
If satisfactory, it is placed on a chain conveyor, passed through the 
paint booth, and then sent to the shipping area. There the end-item 

sampling takes place . The units are sample inspected by a variable test- 
er, at a test stand, and then loaded for transport. 

104 



OUAIITY CONTROL 

Ur* tm, /Ten D»t. OfC. toj9S4 

Hrtlo. /tM-XXXX - C, tnwwiad Igi it,S 



Trn 


Hi 

□ 

rrrr 

rii 

Bni 

Qiaraetarlatief Chaokad 

1 

r.:: : 



Totala 

i Bo- 
feotiva 

1 ' 

■ 

■ 

■1 

■1 

lull 

Hi 

99 





2 

■ 

9 

S 

m 

BB! 

Hi 

pi 





■■■■HPVMMHHH. 

■■H 

m 

ESS 

m 

sa 

m 


WSl 



k 



lllll 


Hi 

i 





5 ' 


EE' 

sai 

PeK 

SHfi 

I 




j 


r*" 




................ g 


E2 

m 

Awe 


r 




- 9- 


^ ” 





7 


n 









- - - e.. , 


■S9 

tsz 

m 

laj 

ss 

R 




^ 9 - 



llll 

BS 

IS 

Bg 

ai 





10 



□ 

n 

n 


pz] 





11 



•a 

KSZ 

SE 

[IZS 

EE 

m 




12 



1 

■ 

ffff 

n* 

E5 

rn 

-.v;, 




13 ■ ■ 




i 

■I 

!■ 

19 

B 





2k ' ' 




i 


s 

HW 


m 

rm 




15 








□ 

LJ 

□ 

B 



l£ 







■ 

9 

laii 

m 

5333 

S 



IT 







! 


'iH 

m 

n 

□ 



IB 







I 


'Hi 


99 

99 



19 







■ 



mJ 

JSE 

J3[ 






’ 


20 







1 


H 

P 

■ 

u 





Total lo. Major Dafaetlm^Unlta 


i 

i 

■ 

■ 


1 


m 


m 

'Hi 

- 

f ■ 

n 

r 


Hill 

n 

u 

■ 

■ 


II 


n 



'ai 


9 

■ 

r 

Sanla Stse 


m 

rw 


■ 


IBH 



;Hi 


9 


r 

2r9avwtlW 


1 

[z: 

\rm 

r 

L_ 



r 

□ 

EJ 

□ 



Proe«fta Arerts* Majo r 


Slide 3 - Work Sheet (Form PBM-7337) 


105 










Slide 4 - Outgoing Quality Trend Chart 
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Unfortunately^ some lots did not pass this sampling Inspection and 
the checldng capacity of the test stand was oi^ a fraction of -fibe total 
production- It hecon^es to find a suitahle j^thod of screening 

these rejected lots. I would lil^ to e;^^ at this point tlitt the 

Production Department must he charged with this screening operation to 
make the program effective. This creates a h^den p^ as 

such, serves as an incentive to correct the ch^acterist^^ caufiing the 
rejection. 

Another place where we have a IOO56 checking operation, plue; end item 
sampling, is the voltage regulator . The regulator, as you know^ controls 
the amount of current the generator produce s> and lets it make |ust 
enough current to meet -^ operating requirements of the electfical sys- 
tem. Without the regulator, the battery and other electrical uiiits would 
soon be permanently damaged, and would, of course, cease to operate, 

If the generator is the heart of your car’s electrical system, then 
certainly the voltage regulator is the brain; it must operate in tempera- 
tures that may range from Death Veilley’s 120 degrees to 19 below zero or 
lower, such as many states experienced this winter . It must operate 
under varying power loads, from the bare essentials of electric^ equipment 
found on the standard models those deluxe Jobs with power storing, 
ibwer seats, power window lifts, air conditioning, and so on. The regu- 
lator has to be calibrated within a ra^ that will serve either type of 
car, so that just the. right amount of current will be avails 
case. That means the blue print specifications must be rigidly adhered 
to, or in a short time we are going to have some mighty unhappy customers. 

The regulators are calibrated "hot"; that is, under conditions which 
Bimiilate normal running temperatures. Under these same ruinaii^^ 
tures they are then 100^ tested by production checkers, visually and 
electrically. Quality Control then takes its end item sample, Consisting 
of twenty-four (24) pieces every half hoxir. These are put on a- series of 
monitor stands^ hooked up with a generator of the specified capacity and 
are checl^d for thirty (30) minutes at normal running temperatures . This 
gives the regulator the same kind of test it would get if placed on a car 
for that length of tixae. If the regulator is not properly calibrated, it 
will show up In this test. Checks ^0 reversed; current 

and cut in, and for temperature compensation. Lots are time S'&ped for 
identification, so that the full thirty (30) minute test is assured . 

The same pattern is followed as for the generators: satisfactory 
lots are loaded for shipment, and rejected lots go back to production for 
screening. 

Our end item sampling often helps us strai^ten out probl^s en- 
countered in previous operations, Scaoe time ago, in making a frequency 
distribution of th® results end item check, we f o\and we 

were getting a non-nprmai distribution. We went ^ produc- 

tion check and broke down the check according to individual operators, 
identifying each one throu^ a color code. We found that the "liggest 
share of end item rejects were coming from one certain operator of the 
four who run this check, A second operator showed almost no rejects 
chargeable to her. The other two had about normal amount -to be ex- 
pected , 

We found that Operator A seldom rejected a regulator at her station, 
while Operator B T«as so extremely critical that she was rejecting 
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practically everything. A thorough discussion and explanation of the 
results ve were after served to clear the matter up with Operator B. As 
for Operator A, further investigation showed that she actually could not 
see well enough to read the gage properly. She was transferred to other 
work where sharpness of vision was not so essential. 

We used a similar study to determine the effectiveness of the opera- 
tors doing the calibrating on these regulators. A 15-piece hourly sample 
was taken from the lOO^t inspection station for each calibrator. Analysis 
of the information showed that one of the nine calibrators checked was 
having between 5/^ and of her work rejected per day — an average of 
for a three -day period. The other eight calibrators had from 2^ to 
rejected . 

The hourly sample indicated that this operator was adjusting from 
the high to the low limits — that is, if she found that the regulators 
she had calibrated for the past hour were near the low limit, she would 
work toward the high limit. She reviewed her work at the ICX)^ inspection 
station more frequently than the other operators in an attempt to stay 
within the limits. Consequently, she was adjusting more often and, 
therefore, was subject to more adjusting errors. The wider distribution 
she was getting was therefoi^ not because of poor worlananshlp, but be- 
cause of too much changing of her setting point to prevent poor calibra- 
ting. This is one of those rare cases where an over-conscientious per- 
son is breeding a condition she is actually trying to prevent. 

The final solution in this particular case was to transfer this 
operator to a different job where her extra-conscientiousness was an 
asset rather than a handicap. 

Because of the extremely critical role it plays in the automotive 
electrical system, the distributor also comes in for a rigid 100^ check 
by Production, followed by end-item sampling inspection to assure a 
quality product for the customer. The 100^ check is performed simultan- 
eously with the calibration of the distributor by means of an ingenious 
test machine . In this case, we get two operations for the cost of one . 
This machine, a cathode ray oscilloscope, checks electronically for point 
gap setting, mechanical advance, and vacuum advance. Calibration adjust- 
ments are made by the operator in accordance with the results registered 
on the screen of the machine. 

The electronic tester is a great advance in the inspection of dis- 
tributors. Before, we were obliged to make a point-by-point check of 
distributor performance, which was at best a laborious and time-consuming 
process . Wow, we are able to see at a glance the whole performance pat- 
tern and make our adjustments accordingly. The operator, in reading the 
screen, can detect such assembly defects as bent shafts, bad cams, bad 
breaker plates, and faulty point assembly. In such cases, the operator 
notes the defect on the assembly by means of a code number, and the unit 
is sent to the repair bench for correction. 

After end-item sampling, satisfactoiy lots are shipped, and rejected 
lots are returned to Production for re-checking. 

The importance of the distributor in the satisfactory performance of 
the automobile imposes the necessity of holding to a 1^ Acceptable Quali- 
ty Level on important characteristics. There are fourteen (ik) major 
characteristics that are cause for rejection at the 100^ production check 
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or at the end item inspe and you can appreciate the way the proh- 

iem of inspection is intensiflM al^ the m line in^prder to 

come up with a satisfactory A.Q.L. at the end. yndersize cam 4joles, bad 
earn contours^ burrs on cam plates^ cams binding on shafts, shorted point 
assemblies, bad springs, cracked retainers, defective diaphragni assem- 
blies — all these require strict in-process controls in order 
teardoim aud repair of the completed units at the end of the line* Here, 
again, is why we stress the role of the production worker in t& quality 
program, depending on him to keep his own operation properly policed at 
all times, with the floor inspector spot checking at stated intervals to 
maintain sampling control. 

In our ignition coil and horn departments we follow a similar pat- 
tern of 'Control through the line, with 100^ electrical testing by Produc- 
tion, followed by end item sampling by Quality Control. 

To sum up our philosophy, if you want to call it that, of Quality 
Control for our Division, we use the techniques that have proved them- 
selves over years of application, but we do not hesitate to depart from 
those techniques to meet new situations. We have tried 
practical and economical phase with the theoretical aspects of the field. 
We have attempted to develop a framework broad enough to satisfy the 
diversified nature of our piyision. 

Now I would like to go back for a few minutes and take anpther look 
at this business of designing quality into our parts ... the obher half 
:of this marriai'ge "we hope will take place one of these days. i 

Let me say right now that the designer has his problems, whether he 
is designing voltage regulators, motors or widgets. His aim is to con- 
trol quality, performance and life of a product by maintaining correct 
fit, alignment and clear^ce of parts . He i^xts to make sure^^ and 
assemblies are interchangeable, and to provide a factor of safjety against 
the possible use of parts outside the specification limits. ;; 

On the other hand, he knows that it costs money to hold to close 
tolerances. It cosbs more for pre-production planning, tool design and 
tool making. It costs more for l^ol a^d maintenance and 

replacement i more for gages and inspection time. It creates more scrap 
and requires more rework. It requires more operations and greater train- 
ing of personnel . 

Designers are coming more and more to realize the of ar- 

riving at a proper compromiBe in the matter of tolerances, so 'that the 
producer of the part can make it in sufficient quantity, and at a compe- 
titive price. They realize that where dimensions directly affect the 
performance of the product, the main criterion should be the functional 
requirements. Conversely, where dimensions do not materially affect the 
function, the main criterion should be the production requireiaents . 

The roots of the tolerance problem go deeper than just making the 
production or assembly job easier. What we as Quality Control people 
need is not simply more realistic tolerances, but a more faithful obser- 
vance of those tolerances. It isn*t a matter of quality verSbs quantity, 
so much as it is getting the most of both by me&is of more efficient 
quality standards. We can* t get away from the fact that every time a 
tolerance is found by production or inspection to be unneceseiiarily close 
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on a part where proper function is not affected, there is a lessened 
respect for all other tolerances specified > On the other &tnd, every 
time production or inspection finds that they run into difficulty "be- 
cause a drawing tolerance is not followed, the effectiveness of the oth- 
er drawing tolerances is increased. 

I think you will agree that a number of things could be done to fos- 
ter and promote a better mutual understanding of the problems of both the 
designers and the production people. 

Designers should get together and define the relationship between 
manufacturing variations and product performance, and agree on the ideal 
fit for a given function. They should then present this basic data in 
such a way that their colleagues in the plant can better appreciate the 
designer's point of view. 

Production engineers should get together and define the relation- 
ship between tolerance and production efficiency, and present to the de- 
signers reliable information as to just what is practical and economic 
from the production standpoint. 

At this point. Quality Control can aid immeasurably by making avail- 
able to Engineering such techniques as process capability studies, root- 
mean-square concept of tolerancing, and statistical techniques of apply- 
ing A .Q .L . ' s by mating part fits . 

Then let Management oil the wheels of collaboration by lending to 
the task the weight of their authority and encouragement, and by exercis- 
ing their function of coordinating opposing interests. 

This is a job where everybody must visuali2!;e the advantages of the 
end result — and work together to attain it. The objective is worth 
while, gentlemen. I invite your active support in bringing the impor- 
signed quality into its tarue position sJ-ongside manufactured 

quality. 

Let's hope that marriage date isn't too fax away*. 
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DEVEIiCXPING QUALITT STANDARDS AND RATINGS 
IN FOmiNG PApm CARTON MANU^^ 

Robert B« Ben8<» 

Continental Folding Paper Booc Co*^ Inc« 

Ihtrodaction 

During the past fevr years, in^ortant Quali^ Control advaiices have 
been made in the B^ufaotnre^p^^^^ Paper Cartons. These advances 

have resulted from applications of modern Quality Control m^heds vith 
modificaticms to meet requiremnts in ou^^ 

For accurate evaluation of folding box quality^ measurable quality 
standards are needed both for appeaxa^ and for funptio^^ X uould 
like to describe in this paper the methods employed at Contineital Fold-- 
ing Paper Box Company in establishing and maintaining such measurable 
standards for our products* 

As stated above^ quality oharacteristips loist be c<mtro^^ the 

folloving two areas t 

A* The Appearances In our mid«»twentieth century self •service mer- 
chandising establishments^ the package has become a salesmEui fpr the 
product* Each package must stand aide by side with numerous competitors 
and virtually to the customer '*Take met** As such the oic:*tpn m 
consistently maintain in *'hi^ fidelity^ ^ if you vill| ill Ihe ori- 
giual intent of advertising and packaging promotion designs* ^s re- 
quires close control of color, register, half tones and general appear- 
ance* 

B* The l^ptioni In addition to containing the product #fely 
through hanging and transit, the carton must have the f6atwe]| of 
maehineability which will enable it to be filled on modem speed 
packaging machines* 

The quality oonf ornanoe in these two arsM ip judged largely in 
terms of attributes* Quality Control therefore requires the 
of visusl standards and fonctima.! tests* 

Defect Classifieation 

Our Quality Cmtrol system is based upon a defeet olaesiflcation 
system for the evaluation of both the appsasranee and functional defects* 
This classification follows the procedures in C* S* Department of 
Defense Saaqpling Plans* 

A *minor defeot**, for which we penalise one demerit, is one that 
does not materially reduce the usability of the unit of product for its 
intended purpose, or is a departure fyom established standaz^' having 
no significant bearing on the effective use or operation of the product* 

A **8erlou3 defect**, for which we charge five demerits, is a defect 
that could res\dt in f^^ or materially reduce the usability of the 
unit or product for its intended purpose* 

We define a **critieal defect** (penalised 10 demerits) as one which 
would cause a oustomer substantial trcnble in fil^^^ the carton^ cr in 
the use of his product by the customer* 
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Referesnee Quality Sawples 

'flie baais for classi:Qring visual def ecta is a st^^rd ^ok con- 
taining sets of samples for each defect* Every set of san$}les 'has one 
carton showing the degree of defect for eaclv severity rating, therefore 
our minor, serious, or critical defects are defined by exanple in a ref- 
erence book available to Inspection, Production Md Sales personnel, 

I thiidc it is Control that mudi more of our 

time is spent in defining ^lerances and st^^ pertaining to visual 
defects rather than measurable defects. It is harder to ar|^e with the 
results of a micrometer, voltmeter or tensile test than to disagree with 
a visual evaluation. By defining our standards with reference,', samples, 
luch^ in this area has been avoided, *^6 defect classifica- 

tion books are applied to all orders from cake boxes to biodfiei^cal car- 
tons, Acceptance for our different customers is based on the |i|umber of 
miner, serious and critical defects each customer specifies as accept- 
able* In other words our standards a^ imif^oim but the specifications 
:vary for each job* 

Control Charts fey fipppessing 

In order to maintain these quality standards throughout odr opera- 
tions, we have established process inspection in all manuldctu^i^ 
departments* Here the product is continually checked against ^e same 
quality standasrds iMch used to judge the finished product* We 

teve been able to prevent defectives from being produced and bkye stead- 
ily improved quality in manufacturing areas by this means. 

Standard control charts are maintained at each of ^o^ presses for 
the information of operation and manufacturing siperv^^ l!^se are 
**0*^ charts which rate quality as the number of defects per sample. In 
our case, they apply to the number of defects per sheet of paperboard. 
Since we are dealing with t^ee levels (cr class if ications) of defect 
sev^ty, an adaptation of the »»C» chart originated ty the Bell Tele- 
phone System is used; this is described by Mr, H* F, Dodge in bis 
article on '*A Method of Rating Manufactured Product** published in the 
Bell System Technical Journal April 1928, The coxrputation for Demerits 
Per Dnit and the Upper Control Limit are shown in Chart #1, 

On this dhayt we M total demerits tmder^^each sev- 

erity classification using average demerits for one day as one san?)!®* 
These represent approximately sixteen inspection visits per d^. 

The last four colupns represent the calc^tions necessajy for the 
oomputations below* C 1^ is ihe total defects divided by the sample 
slee, in this case, ten* W times C bar is the product of the 
severity rating and the average defects; this ^ves the average de- 
merits for the class. The last colpp shows the product of the sev- 
erity squared, times the average defects for edch class. 

The Demerits per unit or sheet than is the sum of the deprits for 
the different defect classes ♦ 

The Upper Control Limit is calcjulated by finding the standard de- 
viation from the last cpliinn on Chart #1, The UCL then is eqhal to 
av* dem-unit plus 3 tinbs the standard deviation. In Ihe exs^ple shown 
here the average demerits per sheet were 12 and the upper control limit 
was 30* 





Chart #2 shovs the application of this technique to the ecntrol 
chart • After some experience irith this chart we became acutely aware 
of two shortcomings I 

1} Data hai to be colleoted orer su^ periods of tiii^ before 

statistical control could be established* In a job shop such as 
QtnrSi this is a serious since many orders nay mn for 

only a few days* 

2) The control limits could ^ply to only one job or set of speci- 
fications* 

]^e-Setting Quality Levels 

To oyercome these shprtcpmingSi we have used our experiasoe with 
past runs to develop a method of pre-setting quality levels for: future 
]^oduction on hew jobs# This has been done by establishing a standard 
formula for such quality calculatlaiiS* 

By means of multiple correlation techniques^ using the essential 
variables which influence product quality^ we have established this 
formula and can now set up immediate statistical control# The dalcu- 
Xatlons for this prediction are simple algebriac solutions p^fprmed 
with ease by our Inspectors# 

Since opr production operations are divided into three bas^l^^^^^^^^ 
Frinting, Cutting and Creasing^ and Finishing, we maintain an ipspeetor 
in each department covering both shifts# Ihe modified "C” chart with 
pre-set limits is utiliaed M^ ; 

Quality Audit 

The Finishing operations are evaluated by an hourly Quality Audit 
which be seen the possible defects which may 

have occof red throughout the plant Are covered# We are able to oonpute 
an average demerit per cartcn figure and a percent defective estimate# 

We have control by die positlcoi number, an important feature for 
isolating defective material# Pux^erwore whaib percent 

each defect is contributing to the quality level# These sheets,, are sum- 
i^rlsed weekly and monthly for the purpose of feedback to Prodpption 
Supervision and Management# The measures erercisM maintain, our dual 
requirements of appearance and function extend into other areaq tlm 
process control# 

Laboratory Control 

With ihll realisatipa quality workmanship cannot be realised 
when inferior materials are used we have esteblished a full tiioe labor- 
atory control of vendor goods# 

IhcomLng p^erboard shipments are randomly sampled for moisture, 
weight, caliper A or thickness), stiffness, water absorption and other 
ij^ortant ohiuc^aoteri^ The results are recorded on a Xaborjatory 

worksheet and analysed for conformanoe to standai^ and specifications* 
Shipments which do npt meet are reported to management with 
our recommendations for disposition* At the same time the def^tive 
material is tagged and held until such time as that dispositiohl has been 
finalised by management * 
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paperboard a^pllers provide us with a copgr of their oim c^ality 
ooistrpl data sheets together with ccaitxol charts so that their '^ting 
can be Terifi^ against our wn results* 

The two sets of data provide us with infcrmatip^ 
establishing process capabilities and for product in^rovement thing 
the statistioal inethpds of Quality Control* 

Ccmtrols over inks and other materiala are exercised in a sindlar 
aianner« ConforiDanee with color standards and resistance to fa4e| 
friction and packaged product are pariicularly^^^^^^i^ characteristics 

of ink which wust be maintained* 

C^iaality Control Engineering 

: .. . ■ ... .. ...... .... .. . ....... ........... , ........... ...... . 

At the same time we engage in as much Quality Bhglneering as time 
and opportunity will permit* tbder this division w 
tribute to process improvemant* experimental investigations* t£e estab- 
lishment of new quality standards and new product quality* 

Besults Obtained 

Of the many benefits realised as the result of our program* the 
elimination of continuous 100^ inspection on key accounts at the 
Finishing Departaient was perhaps the most iispressive* Our screp snd 
rework figures were substantially reduced as were Ihe overall q^ 
costs* The best measure of our success lies in our customers satis- 
faction* which I am pleased to report reflects itself in their favor- 
able comment and ecatlnupusly Increasing order placements* 
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PROBLEMS AND PITFALLS IN ACCEPTANCE SAMPLING 

OF GLASS CONTAINERS ^ 

K* F. Lang 
H. J* Heinz Company 

This paper will discuss tpm^ of practical problems that must be 
recognized and considered in setting up an acceptance sampling procedure 
for glass containers. The discussion primarily to ac- 

ceptance sampling based on inspection by attributes. To examine every 
individual container in a shipment^ or run select tests on every case of 
containers, would require a laboratory force out of proportion to the 
risk involved. It. is here tjmt a^^ w sampling pro- 

gram can be applied at a miiidmiM inspection cost to assure against ac- 
ceptance of unsatisfactory glass containers. Any proposed plari of sam- 
pling inspection, no matter how well defined, requires willingness to 
take a chance. Granted, statistical control techniques can liniit suph 
risks to some degree. 

Some glass companies, while not opposed to user statistical sampl- 
ing programs, are reluctant to promote the adoption of such programs by 
their customers. They are inclined to think of their own procedures as 
being more than adequate to assure their customers good i^commerclal 
quality*'. Customer sampling programs In their opinion, results in d^*' 
plication and added costs for ther^ is U-ttle^^^^^o^ 

On the other J^nd soioe^^ u^^ pf glass containers feel they have the 
answer to all their problems by the adoption of an acceptance Sja^pling 
program* Even the best is not a panacea. 

Through cooperative efforts however, a mutually satisfactory pro- 
gram can be established. This will require frequent meetings with glass 
suppliers, particulariy during the initial stages, so as to prevent mis- 
understandings • 

With these thoughts in mind, I would like to discuss wi^ you today, 
some of the problems and pitfalls in acceptance sampling of glass con- 
tainers. Our remarks will be ^^b^^ have had with ac- 

ceptance sampling of glass containers* We do not intez^ to explore the 
mathematical aspects of acceptance sampling but hope to convey some of 
the practical problems that have come about thTPUgh experience# 

Our present program of acceptance sampling of glass containers was 
introduced during the early part of 1953* This was preceded by a year 
Of investigational work during which time various glass suppliers were 
contacted in an effpyj to coniolida^ and come with a 

mutually satisfactory program, ftere were many details that ndeded 
clarification. (Slide I) The simple matter of terminology wa| an early 
stumbling block. Not only were we confused by terms used 1:^ ihdividiial 
glass suppliers, but were surprised to learn of a lack of cqnmon tez^- 
nology within the glass industry. One supplier frequently did not know 
what another supplier meant In describing a particular type of defect. 

By December of 1953 acceptance sampling of one basic type glass con- 
tainer had been introduced to all phases of our business* Although the 
acceptable quality levels established at that time were considered ten* 
tative, they have proven to have been practical with time and experience. 
We can say with some degree of satisfactipn that the general quality 
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level of glass containers has been improved through such a program* It 
is further felt that through such improvement has come a reduction in 
production downtime j loss of product^ and consumer complaints* 

ifenagement Approval - Selling the Program 

One of our first problems (Slide II) was selling the need for ac- 
ceptance sampling to top management and then selling it down the line* 
Fortunately, as in most aggressive companies, a sound acceptance samp- 
ling program was readily accepted* 

Prior to 1^53 the receiving inspection of glass containers for use 
in our various plants, was dependent primarily on the knowledge devel- 
oped by certain individuals from experiences over a period of years* 
Thus, the degree of inspection at a particular plant differed from that 
of another plant because it was dependent upon an individual* Glass 
containers accepted at one plant were subject to rejection at another 
plant or vice versa due to a lack of uniformity in methods of sampling, 
inspection, and/or interpretation of percent defects found* 

Such a program for many years seemed to have merit* With an exper- 
ienced glass inspector the evaluation (so called) of a glass shipment 
could be arrived at rapidly* Sampling was usually relatively small, 
thus minixBizing the time and costs involved* 

On the other side of the ledger we noted a tendency by individual 
inspectors to sometimes minimise major defects and exaggerate the impor- 
tance of minor defects. With different Inspectors having varying de- 
grees of experience at various plants, there was an obvious difference 
in acceptance and rejection levels* We also found that hasty judgment 
fostered by small samplings was unfair to the supplier and at times 
costly to our company* This procedure likewise gave grounds for debate 
which led to embarrassment for both supplier and user* An effort to 
establish a better relationship with our various glass sippliers and to 
insure unifona quality in the glass containers received, led to the 
development of an acceptance sampling program based on Mil* Std* 10$-A* 
Various meetings were held with technical representatives of glass sup- 
pliers so as to gain the benefit of their experience* 

The result was a program readily acceptable to both management and 
glass supplier* Management was concerned with the initial cost but the 
improvement in quality and line performance justified the investment* 

Putting the R^ogram into ^ Action 

The launching of ary successful program requires careful prepara- 
tion* This is certainly true with an acceptance sampling program. 

An important step (Slide III) is that of obtaining agreement bet- 
ween the user and supplier of glass containers. Bear in mind, the user 
is desirous of perfection with resultant good line performance* The 
glass supplier is conscious of the inspection costs involved to main- 
tain a user's desired quality* 

Once an agreement is reached it is necessary to spell out the pro- 
gram so that it can readily be absorbed by all individuals responsible 
at both the user and supplier's plants* 
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Improper instructions^ lack of definition^ inadequate forms j and 
insufficient supervision can imdermine the program right from the start* 

Classification and Definition of Defects 

Evaluating the relative importance of different types of defects 
can be a problem, (Slide IV} There must be agreement between the user 
and supplier as to the seripushess^^^^^p^ cfit*ain.M a 

simple matter when dipoussing glass containers* For example ^ size^ de* 
gree and location of a defect and its resu^^^ effect on possible 
breakage must be considered. Furthermore, how serious is a boc^ blemish 
to the final end point of the sale of the merchaaiise? 

As each type of defect is evaluated one must first arrive at a com- 
mon understanding as to cause and resultant effect on strength of the 
container* This is nqt alFa^ys easy to do* 

With each defect arises the necessity for agreement with suppliers 
on the significance pf that particuiar defects Uany times it h|as been 
necessary to make tests on pur filling lines with selected defective 
containers so as to confirm an opinion. 

Even' after agreement has been i*eached on ate 
the entire listing of defects is subject to revision based on laboratory 
data and/or line performance data* Some pf PP* present defect classifi- 
cations have beep revised at leas^^^^^ . 

flection of Limit Samples 

Closely allied with the classif icatipn of d^ y) is the 

establishitent of wiimit fampie^ There are iimitaiiops te 
ability to define a typs defect with words alone* Where possible, a 
limit sample is used to show visually to what extent a defect qan occur 
and still be acceptable* This also enables both the user and supplier 
to show inspection personnel the degree of permissible deviation* 

Obtaining agreement on **limit samples** can be a problem* The user 
is concerned with line performance and potential consumer complaints 
while the supplier is cpncei^e4^ w^ ability to sort out ware to the 

prescribed limit sample at a noimal operating cost* Frequently, a clo- 
sure supplier will test a particular finish defect to dete^^^ the ef- 
ficiency of the seal* Limit samples of this type can definitely be 
selected on performance* Over the **bartering table** agreement is usu- 
ally reached at least on a tentative te With experience through 
usage limit samples can be modified by agreement* 

There is also the problem of availability of **limit samples »*• The 
user is dependent largely on the supplier for the acciaBulatipb, o^^ 
samples* A few can be selected by the user on his filling line inspec- 
tion* However, the best source is froin the supple reject urare. 

Still, this may develop into a long term project before a complete set/ 
or sets of exact limit samples can be accumulated. 

One cannot oyer en^hasize the importance of limit samples in the 
possession of both user and supplier. Many controversies can be avoided 
through their use* 
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Establishaent of Acceptance levelg 

Acceptable Quality Levels (AQL's) must be realistic and acceptable 
to both user and supplier* (Slide VI) It is soEaetimes difficult for 
executives or even production supervisors to understand wby one irould 
accept anything but perfect lots* This is aside from the fact that they 
have been working with much less than perfection and that whether they 
like it or not something less than perfect lots will always have to be 
tolerated* As stated by a well known statistician— **You simply cannot 
afford either to ship to your customers or insist on buying from your 
suppliers nothing but perfect lots* The price of perfection is simply 
too great.** 

There are always two views to be considered in setting up an acceptr 
ance level— 'the view point of the supplier submitting the product for 
acceptance and that of the user who must decide whether to accept or re<- 
Ject the shipment* The user requires protection against the acceptance 
of too many defective containers* The supplier^ on the other hand» 
needs to be protected against the rejection of too many good containers* 
He is also concerned with the use of an acceptable quality level that 
he can live with economically* 

Following repeated meetings with suppliers as well as our own man- 
agement groups we arrived at tentative AQL*s idiich were submitted to our 
suppliers for approval* Some suppliers accepted them readily^ others 
with reluctance > and still others on a tentative basis ozily* 

In setting up acceptable quality levels for glass containers one 
has to consider a number of variables which have a definite bearing on 
the ability of the glass supplier to produce ware relatively free of 
defects* We now enjoy a rather high degree of acceptable quality in 
certain containers primarily because they are manufactured on a year- 
round basis* This enables glass suppliers to utilize one machine con- 
tinuously with trained operators* It also permits them to concentrate 
their efforts on improving methods of manufacturing and inspecting of 
finished containers* Another factor is that of design* A plain round 
design glass container lends itself to a better quality glass container. 

One must not forget the ultimate use of the container* This has a 
definite bearing on the demands of the user for AQL's sometimes con- 
sidered unreasonable by the supplier* 

Sample Size 

Statistical sao^ling gives us a means of determining the quality 
level of glass containers by inspecting a relatively small portion of 
the lot* IfafortunateOy, emphasis too of ten is placed on the "relatively 
small" sauple* (SUde VII} 

Many users of glass containers > especially the smaller ones^ cannot 
afford and do not wish to spend any more time than necessary on receiv- 
ing inspection* The cost is too high * Therefore, they are always 
looking for some short cut which generally is at variance with the pro- 
per statistical principles which apply to sampling* There is no known 
procedure for shoi*t cutting sound statistical procedures without 
markedly reducing the efficiency level of the procedure* 
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Sample Selection 

More important (Slide VIII) than the size of the sample is how and 
where the sample is selected* This can be a major problem or jpiSfall in 
the whole acceptance sampling program* 

Inaccessibility of portions of a shipment usually results in a 
sampling somewhat less than truly random* Sampling practices iirhich 
deviate from tiruly random will cause a misrepresentation of the ship- 
rnenti either favorably or unfavorably* 

When a shipment of glass containers is rejected the supplier in- 
variably will mention differences in evaluating the samples anid/or non - 
random sample selection * 

In the selection of the sample of glass containers the inspector 
often faces definite physical difficultyj particularly if a decision 
must be rendered before the shipment is unloaded* Some method" must be 
developed in selecting the sample without bias from all parts of the 
shipment* Trucj physical difficulties must be overcome^ at the same 
time we must guard against inspectors doing it the easiest way* As one 
authority has stated, ^perhaps our greatest difficulty in making the 
sao^le a random sample is human laziness^* It is of utmost importance 
that every effort be made to secure a true raz^om sample since it is 
fundamental to good acceptance sampling procedures* 

Knowing these facts, the user immediately looks for some fubstitute 
to avoid the high cost of strict random sampling* 

Modification of sampling procedures by way of greatly ired^ed sample 
size plus lack of random selection will void the statistical accuracy to 
a degree that will make the plan worthless* 

Glass containers are usually classified as stratified matf rials* 

It is therefore unadvisable to take a large group of cases froi| any par- 
ticular portion of a car or truck shipment* In order to obtain a fairly 
good random sample, it is necessary to sample only a few bottles from a 
case, from many cases selected throughout the shipment* 

In order to overcome the cost factor involved in good random samp- 
ling we developed a sampling procedure for direct shipments at the time 
of unloading* It is agreed with the supplier that if the load is re- 
jected he will stand the cost of reloading* Pre-season ware being manu- 
factured and stored for us by the sipplier is random case saspled for ua* 
Glass containers are then random selected from such random sample cases 
at our plant* While sampling and inspecting for visible defects, our 
inspector sets aside a random bottle or jar for each mold cavity to be 
used for dimensional inspection* 

Physical and Ifechanical Aids for Inspection 

A problem sometimes develops from inadequate or improper tools as 
well as physical surroundings* Insufficient lighting may caus^ an in- 
spector to improperly evaluate visual defects* On the other ha!hd special 
lighting and/or the use of magnification will be questioned* 

In a multiple plant operation it is essential that all plants con- 
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cerned use similar inspection techniques so that glass containers will 
receive the same type of inspection at all points* lack of uniformity 
in physical and mechanical set up can lead to problems* 

Administering the Acceptance Program 

The acceptance sampling costs include not only testing and inspec-*- 
tion costs but also the costs of administering the acceptance program* 
One must justify the additional cost of inspection in terns of better 
quality ware and subsequent better line performance. Quite fl*equently 
a problem arises through inadequate supervision of the program. Assum- 
ing the correct number of glass containers has been selected in a random 
manner^ they must then be accurately and impartially inspected and the 
resiilts property recorded. Correct tabulation of results, feed back of 
information to the supplier, development of proper forms, can become 
problems if not administered in the correct manner. Laxity on the part 
of individuals responsible for the program can seriously weaken its 
effectiveness. 

Au effective sampling program demands the quality of supervision 
that will ins\ 2 re the glass contaiuers being carefully inspected and 
results accurately recorded. 

People to do the Job 

Selection of the right people (Slide EC) to do the job can be a 
problem. They must be exact and patient and have a sense of honesty 
which enables them to impartially examine each lot. They must not be 
prone to complacency due to the repetitive nature of sampling inspection. 
They must be of a nature which avoids forming a biased opinion of a sup- 
plier which would influence the evaluation of samples. The best samp- 
lix 2 g procedure, exact in mathematical detail, is doomed to failure if 
the right persons are not selected for the job. 

One must have confidence in people selected to do the job. We must 
have assurance that samples will be selected according to a prescribed 
procedure, examined without bias, and recorded as found. Furthermore, 
that they must rK>t succumb to human frailties and find *»short cuts« or 
^easier ways to do the job**. 

One must be certain that persons chosen to do the inspection work 
are properly prepared and instructed. There are many sources of con- 
fusion as the novice looks on acceptance sampling for the first time. 
There is a vocabulary to be learned. Usually there is some adjustment 
of thinking in connection with samples and the meaning of samples. 

Keeping the Program ^ Date 

January, 1957 began the fourth year of attribute acceptance samp- 
ling and inspection of glass containers by our companyo Since its oii- 
gin, the program has been expanded to include twelve different types of 
glass containers. 

We are convinced that through such a program we have been able to 
bui^d up a better supplier-user relationship, have raised the general 
quality level of glass containers received, and in turn have witnessed 
remarkable improvement in line performance. The program is in need of 
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furthc^r development to include various other cont^ners MS 
r^ss. At the same time there are sin^lar programs in progress covering 
other packaging materials such as tin containers^ metal closures, labels, 
etc* Although our objectives are clearly defined, there are liDjjitations 
as to the speed at which such programs can be put into operation* THere 
is also a limitation as to personnel and funds available to enable 
strict adherence to an acceptance sampling program* Much still remains 
to be done in deyelopthg the variable or dimensional inspection part of 
the program* Along with the expansion of the program comes the need for 
(Slide X) keeping the program »up to date*** 

With the development of technical "know-how** in glass container 
manufacture as well as improved mechanical and electronic inspection it 
is obvious that the quality level will be improved. Increased ds®an<is 
by the user because of higher production speeds and improved methods of 
product manufacture, necessitate constant pressure on the supplier to 
produce higher quality ware. Subsequently, comes the need for ^ Con- 
stant reviewing of the sampling and inspection program* Re-clai$3ifi- 
cation and re-definition pf defects, adjustment of quality levefs, and 
improvement of sampling andi inspection techniques must be considered at 
regular intervals. 

With this thought in mind, a series of day long meetings whs ar- 
ranged this year beginning in late January and extending through Feb- 
i'uary with each of pur glass suppliers* Prior to these meeting^ an 
agenda was prepared covering the various phases of the acceptance samp- 
ling program. Each supplier had an opportunity to expand on thp agenda 
so as to make it all inclusive* 

Much was gained from these meetings ty preventing some of the pro- 
blems and pitfalls usually resulting from simple misunderstandings. 

Each supplier had an opportunity to objectively evaluate the pi^blems of 
our particular glass container acceptance san^ling program* 

We still do not have the answer to all our problems— we ncyer eX” 
pect to. fd.tfalls Jhaye been avoided and problems have been prCyehted by 
a sincere cooperatiye supplier-user approach to acceptance sampling* 
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QUALITY CONTROL APPLIID TO A JC§ SHOP 

Harmon 5. Bajr^r 
Quality Control Consultant 

Will it work ? Eff ectiye quality control programs have been success- 
fully applied to many job shops in various industries# Considerable 
real savings have resulted from reduced losses. ' 

A large screw machine job shop saved over $100,000 -Mithin otie year* 
Compared to inequality control records, scrap was down 75^, repa:^ 
costs were reduced 50^, inspection labor was reduced b y 60^, and ■custom- 
er complaints were cut in half. Those complaints still received were 
of a less serious nature. 

A rubber concern paid for its quality control program 

within six: months by cutting its hi^ loss scrap items to 20 % of the 
former level. 

A tube manufacturer realized an oyer all say^ of $12^,000. Quali- 
ty control studies helped improve machine maintenance and production 
methods. Customer canplaints were down by 75^. 

The job shop problem of applying quality control methods and the 
usual p^chological deteirent to attempting a program revolves a:|*ound 
short runs and the generally irregular production. These problems are 
not as large as th^ appear if Job shop management will look at the 
facts. 

All phases of management in job shops have faced this problem and 
solved it* Sales, engineering, scheduling, tooling, design, maintenance 
have learned to develop procedures to overcome the short-run hanjjicap. 
Quality control has also sqlyed the problem of build^ a system' to 
control short runs in many companies. 

The problem is not as complicated as it might seem from a cpntrpl. 
standpoint due to the repeat nature of job shop business. Historical 
quality records are kept and applied to repeater items as if no lap 
in production had occurred. Usually the problems of the repeat orders 
are not significantly different from the past quality problems. ;|What 
has been missing, prior to a quality control program, was an organized 
method of communicating past experiences in control problems to repeater 
situations. 

The means of organizing a quality control ^stem comes further into 
focus whi^ it is re^^^ shops seek sales based upon their 

manufacturing skills and available equipmeht and processes. Although 
the production procedures built around a specific order may be different, 
they are, in fact, only a combinatipn of a few production methods ava.il- 
able within the shop. For example, a screw machine job shop may: produce 
one part which requires drill, counterbore and tap, grind, slot, cut-off, 
wash and degrease. Another part may also be produced which may seemingly 
have no relationship to the first part because its shape and sise may be 
entirely dissimilar. However, if one analyzes the operations necessary 
to produce the second part, it may be that the production requirements 
are very similar to the first. An analysis of all parts which | job shop 
produces will result in a realization that these parts fall Ihtq a small 
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number of production patterns. This is the key to the organization of 
a quality control program in a job shop. The control system is built 
around machines and equipment so that regardless of the current nature 
of the product, the processes are controlled and the result is that the 
specific part in production is controlled. 

The basic philosophy of quality control must be accepted by job 
shop management if a program is to succeed. This is the same decision 
that has to be made by non- job shop companies. Briefly, management must 
accept the principle that quality is the responsibility of the produc- 
tion departments. The quality control and inspection departments are 
responsible to develop control programs and procedures, audit the quali- 
ty, determine the problems, trace their sources, and inform the person 
responsible so that he may correct the causes of poor quality. 

In addition, management must also accept the principle that quality 
assurance cannot be obtained by attempting to inspect out the bad items 
at the end of a production system. Quality must be built into the prod- 
uct at each operation and quality control ^sterns must be established 
to control in-process operations. 

Statistical quality control methods are fully applicable and ex- 
treme^y useful €0 the quality control program in a job shop. Any 
program contemplated must be built upon the principles of statistical 
quality control to be sufficiently effective. Some specific problems 
in the application of* the techniques will be discussed later. 

The quality control department needs people. The job cannot be 
done as a part-time responsibility of an inspection supervisor, an 
engineer, or a lab man. Relatively small shops (50 people) will need 
at least one full-time quality control engineer. The larger shops need 
con^aratively larger staffs with quality control engineers, technicians 
and clerks. Of coiirse, shops with less than 50 employees may have to 
modify the principle of assigning a full-time man, but they will proba- 
bly find quality control will become his primary, not secondary responsi- 
bility. Job shop management may not be so reluctant to hire these 
people when they realize that a well organized program will not only 
cover the investment in personnel but pay the company considerable re- 
turns. 

The functional organization within the quality control department 
usually consists of the quality engineering section and an inspection 
section. The quality engineering section develops the statistical 
engineering services and Inspection procedures for the program^ the 
inspection section performs the regular inspection duties, provides 
inspection labor for routine inspection and control charts and special 
studies under the direction of quality engineering. 

A quality control program for receiving inspection is one of the 
necessary phases of a complete quality control program. The organiza- 
tion of the program for receiving is no different for a job shop than 
for any other type of company. There are many excellent references in 
the quality control literature to help the job shop establish this phase 
of the program. 

In-process control . Job shops have found that they are unable to 
provide quality assurance by inspecting a product at the end of the 
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production process. Successful quality control prograins have shown 
that controls must be established at each phase of the operation and 
systems developed to provide a number of service s to ’ 

Determining the source of quality problyns is the major contjribu- 
tion tiiat a quality control engineering section can provide by special 
studies which analyze machines and equipment. The different aspect 
that the job shop encounters is that the results must be analyzed 
only in terms of the purrent problem and the specific part number in- 
volved, but this knowledge must be so organized to apply the results 
to future production which may be similar to the problem at hand^ In 
this manner a body of knowledge is built up concerning the quality 
capabilities of the available By making other 

departments aware of this information, fut^ure designs can be changed, 
machines and equipment can be improved and maint^nod and scheduling 
departments can prevent assignment of specific orders to machine:!^ 
which the studies have proven to be incapable of maintaining tolerances. 
These are just some of the benefits to b^ 

Control charts should be established at ^fficult operations to 
aid production in solving quality problems, ffie use of this tecliinique 
is no dif ferent frpm strai^t line production 5 the clericaX procedures 
must merely be designed around the job shop problem of short runp* 

As an example, an average and r^ge (X & R) ch^t was used Jo help 
control an overall length of a tube (Illustration A). Past history on 
a scmiewhat similar part (although different diMoMr j^ 
used to establish Jemporary limits on the chart. The first run on 
January 10 was short and only a few points were plotted. let the 
ten^orary chart did help get the job corrected (the cut-off saw jwas 
adjusted). 

When repeat order production started on February 3, the chart was 
again applied to the job and helped prevent further quality difficulties 
by Indicating a dull saw wd a needed, a^^ Eljr the end of the 

second run, sufficient data was taken to calculate permanent statistical 
limits for the chart. These proved to be so simil^ to^^^t^^ 
limits that they were not changed. Many job ^ops have found that when 
a few typical machines are studied for specific operations (such as 
cut-off) the chart limits connected with various machines varying 
sizes are so similar that, stajid^d control ch^ts can be prepareci and 
used on sirnilar operations. This is done by reducing all dimensions to 
the variation from the specification nominal (the inidpoint of any 
specif icatipn is defined equal to zero). In many cases the charts are 
used to reflect the production of several different part ntamberSp in 
the order of their production, on a certain machine (or machined:) with- 
out loss of the chart \s ability to detect quality problems. Par; 
further informatiqn on the„ application of the X & R chert to job shop 
problems, please refer to the Technical Supplement to this paper. 

In-process inspection systems . Control charts and quality engi- 
neering studies will help reduce quality problems but an effectiye 
quality control program must also develop routine in-process indpectlon 
systems to assure control of the product at each machine or process. 

Inspection instruction sheets must be developed to give production 
operators and inspection personnel full knowledge of the customer ^s 
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quality demands. Usually, this is where job shops without quality 
control programs fail in their quality goals. Communications must be 
effective and complete so that all the information necessary to do the 
quality job flows from customer contact to production and inspection 
personnel, 

A typical inspection instruction sheet for a job shop (Illustra- 
tion B) gives details concerning the inspection points at each opera- 
tion, the specifications, the inspection methods, etc. Posting it at 
the operation accomplishes the purpose of informing the operator and 
inspector of the exist omer requirements, 

i^eparing these inspection instruction sheets for each operation 
can be complicated. It is simpler if one remembers a principle stated 
earlier; most job shops find that although a large number of different 
parts are produced, actually only a reasonably small number of dif- 
ferent production method combinations are used. Based upon this, 
standard instruction sheets are prepared to cover a family of parts 
(in Illustration B this is a “Flat Goods” family). These items are 
typewritten or printed and reproduced on the standard form. The 
specific items related to the particular part involved are filled in 
where necessary (in Illustration B these specific items are hand- 
written), The unused items are crossed out. These clerical methods 
and many others similar to this must be developed by job shops to 
simplify the clerical problems created by the large numbers of possible 
items and short runs. 

Jigs, fixtures and gages for checking production must be available 
at each operation so that the operator and the inspector can check the 
part at the operation frequently enough to assure good quality, 

“First piece** or “first run “ inspection must be established to in- 
spect the first few parts immediately after set-up. This should be 
more complete than a regular inspection, almost layout in character 
but somewhat simplified. This inspection should quickly detect errors 
in tooling and set-up. Jobs should not be allowed to run without this 
type of inspection. 

An identification system which identifies all lots of product must 
be established. Each operator is required to record his identification 
number, the amount of production and similar items. This makes tracing 
of the errors possible. It has been found that this identification 
system is indispensable to an effective program and, in reality, a 
small investment compared to the dividends received from the qystem. 

Routine roving inspections are made at each operation on the basis 
of the inspection instruction sheets and standard statistical acceptance 
sampling plans are used. Please see the Technical Supplement to this 
paper for farther information on these plans. If the lot passes the 
sample, it is allowed to proceed to the next operation. If it is re- 
jected, it is returned to production supervision for action. This is 
based upon the previously stated principle that inspection only audits 
quality; production is responsible for good quality. The production 
supervisor may elect to return the lot to the operator for sorting or 
repairs. In any event, the lot cannot be used by the next operation 
or proceed to the customer without correction by production and re- 
submission to inspection for approval. 
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F^al inspectiori or audit ingpectlon should also be acccanplished 
td-th the use of 'standard statistical acceptance sampling plans* Job 
shops will find that this can replace 100^ inspection of items and give 
the management and the customer increased protection at a reduced cost. 
In addition, as the in-process inspection programs develop efficiently, 
it obviously becomes unnecessary to audit most items and this effort 
is curtailed, lots rejected in this final or audit inspection are re- 
turned to the department responsible for the problem for correction. 

Complaint investigation . Complaints from customers or from other 
operations or departments within the organization should be fully ex- 
ploited to prevent future quality problems. Unfortunately, some or- 
ganizations merely ask the inspector, *»How come that got out?** " A 
quality control program investigates each complaint, detemines the 
source and the responsible production department, requires a statement 
from that responsible party for the record concerning his actiphs to 
prevent future recurrence and projected correction date. In this man- 
ner the acceptance of the responsibility of production for quality is 
gradually developed by the organization and the complaints reach the 
party that can and should do something about the problem - the tian who 
makes the item. 

Quality control will work in a job shop . The techniques ^e fully 
applicable j the methods effective, Mary job shops have found t^t the 
programs pay handsome dividends. The usual deterrent to starting a 
program is the concern it m^ not prove effective. It is hoped this 
paper dispels some of these doubts, ' 


TECHNICAL SUPPLEMENT 

X & R charts on short runs where no previous experience is ap- 
plicable to place limits, use the following effective chart. Assume 
that the process is just capable of meeting tolerance. 

Then 

Tolerance « 6 ^ 

Tolerance » 6S 

Asstme sample size of ? and B/P specification of CH-.OOS (tolerance ■ 

. 010 “) 

.010 - 6E 
^7525 

I - .0039 

Then the ^ - 0 (specification nominal) and control limits would ha; 

C]jf *• X + A2E 

- 0 + .377x .0039 ’ 

- 0 + .0022 
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The range chart limits would be : 

UCI^ • 

« 2,11 X .0039 

- .0082 

lcir » 1)35 

- 0 

The significance of the chart is as follows: Place the chart on the job 
immediately. The range chart out of control indicates the machine or 
process is not capable of maintaining the operation within specifica- 
tions. Out of control on the X chart indicates need to adjust to ma^- 
tain specifications. If process is better than specifications, the X 
chart may cause some over condensation since the limits will be narrower 
than is necessary for control within specifications. 

On X & R charts for a process where the capability is better than 
the specification, it is advised that modified limits calculated as 
follows be used: 


UCLJ ■ Upper Spec - 
LCI^i * Lower Spec 4* MR 

where M ■ Q " Ag) 

dg 

Statistical sampling plans . Because of the confusion of parts and 
production, it is necessary in a job shop to make a basic decision in 
the use of statistical sampling plans to limit the use to a few standard 
plans. For example, the decision might be made to standardize the in- 


process plans as follows: 

Defect 

Sample 

Acceptance 

Rejection 

Classification 

AQL 

Size 

Nuinber 

Number 

Critical 

0.25^ 

50 

0 

1 

Major 

1.0^ 

15 

0 

1 

Minor 

(>.% 

5 

0 

1 

Incidental 

10.0^ 

3 

0 

1 


Slmilarly standard plans would be developed for audit and receiving in- 
spection, Through this method of standardization the training of in- 
spectors and the carrying out of procedures can be simplified. In- 
spectors can be taught a simplified routine connected with a few sampl- 
ing plans, and can concentrate on the confusion created by the con- 
stantly changing inspection instruction sheets. The quality control 
engineer and the specification engineer, on the other hand, can place 
a particular defect in any of the standard AQL*s or in some cases, if 
they do not strictly apply, change the tolerance to make it applicable 
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to any of the stand^d AQL*s* For example, a .010*’ tolerance witfo a 
% AQL is approximately comparable to a .012*’ tolerance with a 1^ AQL. 


^ * 
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THE DESIGN & ENGINEERING OF TEST EQUIPMENT 

FOR COMPLEX ELECTRONIC PRODUCTS’ / ; L , 

Michael Gebrian ;; 

Sperry Gyroscope Company 

(1) Perhaps it may be more correct to paraphrase the title, '*The 

Design & Engineering of Complex Test Equipment for Modern Elec trpnicj 

Products’'# Electronic and electromechanical products are all complex, 
to varying degrees, and always have been; however, the recent rjapid 
advances manifest in the design of prime military products in d^der to 
meet exacting accuracies present a challenge to the test equipment 
designer and a problem in the maintenance of quality control. 

(2) It is not the intent of this paper to present a detailed 

technical exposition of test methods and ^ commonly eiriijioyed 

in the industry; numerous books and pamphlets on this subject have 
been published by military and civilian agencies. Rather, an ! attempt 
will be made to highlight some of the difficulties faced jointly by 
engineering, manufacturing and quality control in the productlcp and 
acceptahce of primary military equipment, and to suggest possible 
means for circimiyshting these difficulties. 

( 3 ) Briefly, these obstacle s fall into several general areas; 

(a) The effect of the measuring tool on the quantity to be 

measured# 

(b) The need for close coordination of the ^^t^ design 

concepts - product and test equipment. 

(c) Administrative control of test equipment design* 

(d) The goal of special test equipment design# 

^^f£gct of Meaffliy^eul 

,1) The inspector who Tneasures the p.D, of a shaft with ^ 
micrometer is probably unaware that the reading he extracts fs ,;ih' ” 
error by the amount of distortion the shaft is subjected to because of 
the pressure of the caliper. If he is aware of this, he can rightly 

discard this error; it is either imeasur able 

considered. Hpweyer, the test methods engineer faced \d.th the . 
problem of measuring torques of i dyne centimeter, voltages and 
frequencies in the order of fractiqns^^p^^ one percent, and ratios of a 
resistive summing network to #01/5 cannot disregard the effect qf the 
device he uses or the methM upon the quantity he observes. 

The error contribution may well equal or exceid the toleranc^ spread 
of the particular parameter; thus, he cannot justifiably accept or 
reject the unit under test. As an example, consider two resistors, 

R1 and R2, which form a summing network as shown; 





139 



It may be required that each resistor has a tolerance spread of 2 %^ 
which can be measured, but that they be matched to achieve a ratio of 
1 ± *01^5 ie, the ratio R1/R2 = 1 ± .01/5, Selection of matched pairs 
by ohmic resistance measurement is not practical; in the worst case, the 
Individual values of R1 and R2 would have to be determined to an 
accuracy of *005^; such accuracy is not obtainable with present ohmeters, 
including the digital type. Another approach is necessary: one that is 
feasible is a nulling method employing the resistors and a precision 
ratio transformer in a bridge circuit, Even then, the error contribu- 
tion of the transformer may have to be taken into account, 

(2) It is not enough, however, to determine a technique which 
will minimize the effect of the measuring tool; it becomes necessary to 
evaluate the extent to which product accuracy is degraded ty the type 
of wiring employed between the test fixture and the unit xmder test* 

In many cases, observed readings are appreciably affected by wire type, 
electrostatic and/or electromagnetic shielding, lead dress, and by the 
grounding method employed. 

(3) The simple example stated above is illustrative of the extreme 
care which must be exercised by the test fixture designer in his approach 
toward methodizing a particular test operation on either a system or a 
component of a system; on the other hand, it is incumbent upon the 
product designer and/or the engineer responsible for the preparation of 
the test specification to not only keep up to date with state of the 
art" test concepts and instrumentation, but to include errors intro- 
duced by monitoring equipment along with product component deviations 

in his calculations of nominal values and tolerances. 

ClQgg....i?Q,Qyainati.9q...,p£. Produst, ...Q est F telaiEa Be„!si^,CgQg£afca 

(1) It is a truism that the ideal is not attainable. The present 
highly competitive state of the electronics industry in the area of 
government contracts dictates that beside cost, quality is an important 
factor in obtaining sales. The key to quality is performance in terms 
of reliability and accuracy, attainable to the extent that the basic 
design approach of the prime product and the selection of its components 
are sound. The engineer must apply particular care to avoid the 
dilemma of uncertainty which may occur when his prime product fails to 
meet required tests. He may not be able to determine conclusively 
whether the design of his product is faulty in some respect, the test 
specification is invalid or unrealistic, or whether the test philosophy 
employed has degraded the performance of the system, 

(2) The performance of an electronic product can be theoretically 
calculated by determining the root mean square value of all the errors 
produced by the components which make up the system, provided these 
errors are Independent of one another. In the process of establishing 
the test specification nominal values and tolerances of the system and 
its sub -assemblies, the product engineer must include the effect of the 
test device, and must provide the necessary access points for testing. 
This is particularly applicable where wire length may contribute to a 
deviation from the nominal value as well as the monitoring device 
itself. By administrative fiat, the effect of the test fixture upon 
the product being tested may be discounted if it contributes no more 
than 20 % to the allowable tolerance spread of the specific test 
function. The application of this rule is a good yardstick for the 
designer of test equipment, but the product engineer must take into 
account the limitations it may impose. For example, if a voltage is to 
be metered to an accuracy of .05^, the instrumontal error is limited to 
.01?; this precision is not practicably attainable for the measurement 
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of absolute values • An iudirect approach would be necessary, perhaps 

by a determination of, a relationship of that voltage with respect to 
another parameter, ' ■ 

(3) As a general rule, it is good practice to s:^mulate the 

actual environinent a product subassembly, undergoing test, might 
encounter if it were installed, i^^^ avssembly* That is, 

the load that a product amplifier will ’'see*' in the next assembly may 
well fe incsbrpbrated a^^^ the test equipment. Frequently^ the 

product engineer will specify that the test of a component be conducted 
with its associated product mates, or equivalent. However, this prac- 
tice must be analjrzed in every instance by the test methods engineer 

to prevent reductio ad absurdum. For example, making a closed loop 
test of a dissociated serve amplifier by ihstallih^ the other wservo 
components in the test fixture would be pointless; it may serve : to 
evaluate the basic product design concept, but from a product iqp 
viewpoint, it only serves to ” test the tester”. In addition, tjie 
concept of system simulation may lead to an element of uncertainty in 
the use of a product part as a test fixture load; application of the 
20^ rule may serve well to reduce the effect of the measuring tool, 
but may not reflect true system performance. ■ 

(4) The high order of precision required in modern electrpnic 

gear demands extremely close collaboration between the product engineer 
and the test equipitient designer; each must be familiar wi.th the" design 
problems pre cull ar to his cclleague's area of responsibility. Test 
specifications must be valid and realistic, while the associated ^^st 
equipment must cqnf pxmi ^tC ^ specif icatioh fe The two 

functions cannot be divorced; the two principals constitute a technical 
team with the conmicn goal of producing a verified complex product. 

Administrative As pect s of Test Equipment Design 

(1) The art of special a^ instrumentation is hard 

pressed in keeping up with the fast pace of technological progress of 
military and civilian electrqn^^^ products, especially in the field of 
inertial navigation. As a result, it has become a highly specialized 
area of test philosophy and techniques in which the test equipment 
engineer, test engineer, or test methods engineer, whatever hi|' title, 

represents the technical raainstay. His is an important role in ,t3^e 

control of quality and economy, for a successful test fixture design 
presupposes a thorough familiarity with the product, with engineering 
practices, manufacturing methods, capabilities and limitations, and 
with the progress of electrpnic instrumentation. f; 

(2) The question as to whether administrative control “oyer test 

equipment design should be an engineering function or a quality’ control 
responsibility is a debatable one. On the one hand, it can be argued 
that coordination of the product and test design approaches cap be 
better effected^ central control, and will result in economy by 

reducing duplicity of effort. In this sense, duplication is avoided 
by repackaging the breadboard test set-ups initially employed in 
product design evaluation. In addition, compatability be tweeh‘’ design 
evaluation and production test results is Tnore easily^^^ since 

the method of test is the same in both cases, with phly the added 
factor of human engineering applied to the factory test fixture. There- 
fore, engineering control is warranted, for the importance of .plose 
liaison between the two design functions has been emphasized before. 

(3) On the other hand, there are several reasons to support 
the contention that test fixture development is a quality control 

function. Of course, a basic assumption must be made that tjie 
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necessary technical skill is available in either case, so the question 
is purely one of administration. For one, test results of a product or 
its components are as much a measure of quality as are control charts 
for a machining operation or methods for statistical sampling. Control 
over these results can be exercised by monitoring all phases of the 
manufacturing process to the final stage of customer acceptance. This 
will depend for the most part on the performance rating of the system, 
determined by testing to a specification with special test equipment* 

On a production basis, this is a manufacturing fxmctionj although 
quality control is geared to mantifacturing processes, it should play a 
positive role in the preparation of the final test specification. This 
is important, since this document is the basis for design of special 
test tooling. It follows that quality control should carry on with the 
task of producing the test equipment, 

(4) Here, incidentally, is one phase of quality control activity 
which does not require much selling to management. In its final state, 
an electronic product lies somewhere between engineering's ideal version 
and manufacturing’s practical approach to the ideal. In terms of per- 
formance, its quality will vary between these limits, yet may stay 
within the acceptable region. In terms of cost, however, the difference 
might be prohibitive the closer the ideal is approached. It is in this 
activity that quality control can insure a proper balance between cost 
and performance by having a voice in the preparation of the test speci- 
fication, and by designing test tooling with this goal in mind. It is 
debatable whether this objective would be attained as effectively if a 
single agency were responsible for product design and engineering, the 
generation of test specifications for that product, and for the 
production of factory special test equipment. Generally speaking, 
engineers, collectively, tend toward idealization; manufacturing leans 
toward the practical. Quality control is an effective buffer between 
the two divisions in the field of testing. 

o f , 

(1) The characteristics of properly designed test gear are 
straightforward and unimposing, yet, like the proverbial stitch in 
time, usually achieved by hindsight. This is true especially if funding 
and time are restrictive; yet they are essential for minimizing potential 
product difficulties. Briefly, the goal is fourfold; 

(a) Simplicity is important. It is not to be inferred that 
the design is simple in concept; on the contrary, modem electronic 
test equipment can be quite complex in detail. By simplicity is meant 
uncomplicated in operational use, and designed with a view to reduce 
instrumentation and/or circuitry to a minimum; in effect, to discard 
the Rube Goldberg approach in favor of the more direct. Cumulative 
errors increase in proportion to the amount of devices appended to the 
unit under test. 

W Reliability is becoming more and more necessary, in 
keeping with stringent reliability requirements of guided missiles. 
Inherent in reliability is the element of accuracy, of course, but an 
equally important feature is durability. The designer is often tempted 
to strive for an aesthetic result in a particular "black box" which may 
perform a required function in an elegant manner. This may impose a 
problem of maintenance and calibration, however; test fixtures are in 
constant use in production testing. For example, a device which must 
produce a series of discrete timing marks at specified Intervals 
could be done very elegantly by a banlc of electronic flip-flop circuits, 
but a mechanical gear and cam setup will be more stable and long lived. 
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(c) Accuracy is self*~evident, as a characteristic pf depend- 
able test fixtures. Kany dilemma producing que st?. on s about the.'lpeTfcr- 
mance of a system can be avoided by the proper choice of circui-jiry and 
ins trumentatipn used n the test equipment . Included . in ■ this i| the 
element of repeatability of observed readings. 

(d) Flexibility is the keynote of design. It is becoming 
more and more apparent that the number of emergehcy and normal changes 
to an electronic system vary directly as its complexity. One thpi^sand 
per month is not unusual, and many of them affect the associated test 
equipment. These changes are a bane to the designer’s peace of mind, 
and frequently the subsequent fixture mpdif i, cations 

enough to cause a delay in production. Flexibility is a most desirable 
feature, and may be realised by careful thought to switching, choice of 
instrumentation, and by the judicious use of programming deviceb such 
as patchboards or punched card systems. Adaptability also contributes 
to ease of maintenaucp , and calibration^ n^^ periodic operations 

for the maintenance of quality. '' ' 

Conclusion 

(1) It is beyond the scope of this paper to discuss autpmati on 

concepts and techniques as applied to test equipment. Designing to 
this end represents the ultimate in complexity, and is difficult tp 
accomplish unless product drawings are relatively frossen. Semi-auto- 
matic or manually operated electronic test equipment is intricate enough, 
especially in the field of inertial . guidance or missile systems:, which 
are undergoing rapid technological evolution. Support equipment is big 
business, however, and the trend toward automation for field use is a 
question of time an4 limited only by the test engineer ’Is 

ability to keep pace with new developments. 

( 2 ) The principles outlined in the preceding paragraphs are 
fundamental, yet they present a challenge to engineering and quality 
control. To draw ananalogy: the contriver of the weapon of d^i^cnse 
faces the prospect of not being able to cope with a new offensive 
weapon. The test engineer’s nightmare is to be confronted wit^ a new 
product which cannot be tested conclusively. 
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cpArm coin^L*s CDiigmoN to mmwmn and custcher’ 

ON mjABiijra OP 

J. W* Young 

North Ai&erlcAn Ayiatlon, Inc. 

The stibject of quality control's obligation to manageimeiyt and the 
custcmep on reliability of coniplex weapons is very broad and cafe be^^^^d^^^ 
cussed from oiany viewpoints* I will eonsidar our obligation to manage* 
mexrt and our ciiptcaitr would sera that nanfegraent 

of a crapany would have the same feeling toward deilv^ing reliable pro* 
ducts as the customer would have in receiving them* Also^ I will con- 
sider msnagraent as top level management in the conpany and our ' custom- 
ers as the Mlitary se^ as evidenced by our subject and tyo of our 
panel meiia^ 

There are many ways that conpanles have changed or supplemented 
their organizations to deliver mo^^ products to the services* 

X do not feel there is an id^ organizatibn for reliability or any 
similar aspect of a complex i^apon which can be introduced^ in %, given 
cdiopah()r« Organizations are often decided by the oapabiilties of avail- 
able persozmel, as well as the overall conpany organizational structure* 

Regardless of where tbe sroup or groips identified with re^iaiy^^ 
are positioned in the organization^ there must be the desire enthu- 
siasm of top management and all depaartairats in^ SiCcept the con- 

cept of reliability and work toward these reliability goals* Xt is 6p- 
parent that engineering^ quality control^ mraufactwingi and pihrchasing 
am the deparibiients ^o can contribute the most in delivering reliable 
ecwplex weapon systems • 

Nhile I feel that engineering^ by the very nature of its ybrk, will 
always carry the greatest share of the loed^^ ra greatest con-* 

tribution to r®ll^bl^^^ quality control is also a major contributor* 

It has been sifted control is interested 

ities that are directed toward production of usable and reliable 
products at a mlnlran overall cost* It is obyioi» that a quality ccm- 
trol function. In ■|!n^,...brNs®iiz^^ 

However, quality control's usually recognized msponsibility naitural^ 
requires it to be interesl^ in most activities in the company which in- 
fluence the delivery of reliable products* 

■■■■■■' . ■ 

The very nature of quality control and inspection lends itself to 

the recognition ai^ need^ to iaprove features In the products whleh ex- 
perience, good juid^nt, or statistics indicates a change should be made 
Immediately or at w early chat^e point* In action to assuri^ng that 
a quality product is being delivered, we must get data back to engineer- 
ing, seuQUfacturing, and pisrchasing in a factual form wbi^ Will help 
them, and in cases where action is needed/ follow throiagh to be certain 
that it is taken* 

I believe there will be v^ few instances >rtiere another department 
will not welcome and encourage information and reccramndations ,,ffra 
quaUty control if they are propw and Which will help that 

department to d.o a better job* To mSke this cpntributipn, quality con- 
trol must ec»mra^ the^ of engineering, manufacturing, and puf- 
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cliasizig* We will only get this respect by developing our people to ap- 
preciate their responsibility in this regard and cdso to understand the 
problems and nature of the other departments* work* 

Too many times, I have heard engineering personnel s€^ that they 
had to make investigations or gather data themselves rather than rely on 
quality control because they did not think quality control had personnel 
who could do the Job. This may or may not have been the case, but it 
was apparent that quality control had not been aggressive and done the 
Job they coiad have done or possibly in the way they should. 

If we are going to build co^lex weapons with the reliability that 
our customers are asking, quality control must be an aggressive, alert, 
and technically minded organization. This is an approach the head of the 
quality control organization must promote, not by words, but by actually 
showing other departments the contribution they can eaipect. 

As our weapon systems become more complex, the prime contractor and 
second tier contractor will be getting many more systems and functioning 
parts from st^pllers. These larger and smaller suppliers in many cases 
do not fully xuaderstand the conditions and environments under which 
their prodxicts will be esqpected to operate. Also, in many Instances 
they do not appreciate the quality level and reliability that the com- 
plete complex weapon requires, or really appreciate the Job they have 
contracted to do. 

I feel that relations with the supplier is a very isportant phase 
of reliability where quality control has a principal role, and where 
there is real work to be recognized cmd accomplished. We must do a 
great deal more to evaluate the past perfonoance of stqppliers and sur- 
vey their capabilities to build reliable products before they are given 
a contract. I do not mean Just compiling suppliers* rejection records 
or rating stppllers on past performance. 

After a siqiplier has been recognized as being capable of doing the 
Job and has received a contract, we must work with him and recognize 
trotible areas and bring engineering and manufacturing in to help the 
si;^plier as early in the contract as possible. We must bring the stq>- 
pller into our plant for quality and reliability syo^siums and have 
quality control, engineering, purchasing, and manufacturing partici- 
pate, ai^ encourage the st^plier to feel a paarb of the team. 

There are many items which aire purchased to a design objective spec- 
ification written by engineering* Oftentimes, the stiller designs the 
paart and makes decisions which the contractor *s past paractice and ea^e- 
rience have shown to be poor. When engineering reviews a s\q>plier*s de- 
sign before parts axe made, quality control can contribute materially 
with experience and test results they have gained from similar parts in 
the past. These, again, are areas where quality control must make their 
contribution to the economic production of reliable products. 

Qluality control is in the position to observe deficiencies origi- 
nating in all phases of the production of cong>lex weapons . In this con- 
tinually changing bissiness of producing cooplex weapons, management ex- 
pects quality control to develop an organization \diich is progressive, 
forceful, and effective in contributing to the reliability of con5>lex 
weapons. 
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THIS IS 1KSP|;CTI0H AUTOI^ION 


W. W. Spencer 
General Blectric Company 

Is automation, inspection automation, in your future? If one is 
to Judge by the tremendous surge of interest and evident anticipation 
with which most people react to this word "automation,** it certainly 
is. So that such interest and anticipation may be satisfied, let us 
examine this matter of inspection automation for the purpose of putting 
it to work in our business. 


Inspection automation is that portion of autpmatipn tba^t^ 
to the taking of measurements, processing the resulting data an4 feed- 
ing back the resu its for control . We can hereaf ter 
control automation whenever we wish to indicate inspection automation. 
This leaves us with process automation as the other side of the| coin. 
Together process automation and process control automation make, up 
total automation, 

Process eontrol autqm growing rapidly in Importance to 

all of us. Many experts agree that in the next ten yhars larger and 
larger amounts will be spent by industry for automatic control pf manu- 
facturing. In fact by 1967, today's amount spent will double ahd may 

very well triple. Thirty percent of all manufacturing equipment dol- 
lars will be spent for quality control equipment and fifty perdent for 
all control equipment. Automation certainly is in your future -JJ 

Some refer to the age of automation as the second industrial revu" 

lution. Automation is not a revolution, but rather it is an eyolution. 

Neither is it new. In 1784 Oliver Hyans built a completely automatic 

flour mill near Philadelphia. This mill was truly autbi^tic since 

there were no workers in the mill* True automation may be defined as 
continuous automatic production. There are, therefore, severa^^^^^^^ 
from manual operation to full continuous automatic production. ; These 
steps start in the manual area and move through the mechanization area 
to automation, ^ There will be many justified instances in our business 
where the nearest to automation some processes will come will be 
mechanization. 


For instance in 1661, in Danzig, Germany a mechanized lootii was 
built that wove as many as four to six webs with variable complex 
patterns. This loom and its successors have produced much wealth. 
Whether it should ever be systematized into a continuous autpmjafic 
line from fleece to cloth bolt is a question only a sound econiomic 
analysis could answer. 

Other processes will never be automated because we 
identify and define the specific quality criteria we should be. measur- 
ing to produce automation. In the petro-chemical Industry we have a 
high degree of mechanization based on measurements like reacti^on tem- 
perature and pressure and material flow, but due to our inability to 
accurately identify the criteria for product mix, such as fuel oil, 
kerosene and octane gasoline and the quality criteria of the products, 
we cannot measure them and feed back data for complete automation, 
which includes automatic process control. 
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In mechanical proceaslng or manufacturing we do not have this 
limitation. 

Instead 9 we do have a unique opportunity to reach out towards 
process control automation. Since we can clearly define and measure 
most quality criteria in a machining operation we can have a process 
control mechanization as a definite opportunity. 

The temptation in machining is to become trapped by thinking only 
of individual operations and not the overall system. We must systema- 
tize any proposed mechanization and justify it only in the light of 
what is best for the entire process of raw material to finished pro- 
duct. 


Mechanization and automation may be, in some cases, sure-fire 
ways of achieving sudden death, of putting ourselves out of business. 

A profit, an economic benefit, must accrue to the total process in 
order to justify whatever degree of automation we attempt. Sometimes 
this benefit comes from cost reduction, increased production, better 
quality or just being able to do something we could not do in any 
other way. Thus a properly evaluated and systematized mechanized or 
automated process, including process control, will be profitable. 

In cases studied, it has been found that process mechanization is 
very profitable but at times it has been handicapped by little or no 
process control automation. As a result, process control has become 
a bottleneck. The truth of this is borne out by your own knowledge of 
mechanized processes where material or product is removed from roechani* 
zed production for hand inspection and returned to the continuous 
operation. On one cylinder block line where a mechanization profile 
has been drawn, there are twenty-eight process operations and eight 
process control operations. TWenty-four process operations are 
mechanized above the hand stage but only one process control or in- 
spection operation is in this category. This is a typical situation. 

It would be helpful to have some way of measuring our manufactur- 
ing so that we might clearly and simply see the true situation. Just 
how much of a bottleneck is process control because of a lack of 
mechanization? Since automation is an evolution, we should be able 
to set down the principal steps one climbs from bottom to top and 
match our attainment; i.e., how far up the ladder we have to climb for 
process mechanization and process control mechanization - Fig. 1 shows 
one way we can picture the evolutionary ladder for process automation. 
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Fig. 1 
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5. automatic 
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7. machine or power 
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100 



0 

direction :pf 
increasing: 


Note as we progress up the ladder we require an increase , in the 
amount pf control (process control) and also labor skill . This means 
that unless our process control mechanizatipn keeps pace it becomes 
a more and more severe bottleneck. 


Now to construct a corresponding ladder for process control 
automation. Our process contrpl language differs somewhat from our 
process, so Fig. 2 should help us better to visualize what ye.yill 
mean by the terms o| pur process control automation scale of progress. 



149 



Fig. 2 

ANALYSIS OF PROCESS CONTROL MECHANIZATION LEVELS 
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The manual an: ea stax'ts j^itji^^^^^l^ use of simple hand gages Which are 
either fixad or adjustable and give go and not-go infortnation.; The 
first upgrading would be to indicat;ing gages which give us injfbriijation 
in terms.,.. of . variables. 

Following this is mechanization. Then it to up- 

grade so that inlprmatipn can be obtained to indicate process trends. 
Following this post-process decisions can be made that will exercise 
on-and-off controls. 

And last, the automation area, where there is a gradual evolution 
from pn-and-pff„ step adjustments through in-prodess 

guidance and adjustment of the actual process itself to pre-process 
measurements with prediction control. 

The final step is the tying- together of individual machines with 
interlocking controls into blocks, lines and ultimately a factory. 

From Fig. 2 we construct Fig. 3 

Fig. 3 


PROCESS CONTROL AUTOMATION 
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By combining on a scaled grid the scale of progress for process 
automation (Fig. 1) with the scale for process control automation 
(Fig. 3), we can now actually indicate the status of automation for 
(a) process and (b) process control. We have plotted lines A and B 
from typical operation information. 

Fig. 4 



152 










Fig. 4 permits us to recognize the relatlpushlp between process 
and process control autoB^tlon for e^ or point In 

the manufacturing cycle. It also perndts us to average the Ilifefence 
between the numerical Indexes, jn the case showfl In Fig. 

4 they would be: 

process mechanlzatlpn _ ■ average index number 

process control mechanization • 28.6 ** ” **’■ 

We clearly see by either relationship that there Is a Ipng way to 
go in automation - especially in process control automation* ; . We ^c^ 
also use thlt dlegram as a basis for determln^^^ our greatest need and 
area of greatest potential improvement. 

However, before proceeding to correct these unsatisfactory rela- 
tionships let us look at some other helpful tools for more c^pletely 
analyzing how to take corrective action. ■ 

First, answers to these questions should be found: 

(1) What are the qvuility character is ticp that we can 
measure and use the information for controlling 
the operation? 

(2) Are these measurements properly organized in 
respect to the total manufacturing system? 

(3) Can we make available ''sensing" elements for 
these measurements? 

(4) Will the sensing elements feed opt useable si^ 
for the control system? 

(5) Is this mechanization econo^cal? ^^^ 

With this information in preliminary form at hand, we construct 
four definitions applying to the specific operation we wish, to up- 
grade through mechanization and automation. Xhesa are deflni^ 
of; ' ■ 

(1) The measured quality criteria 

(2) the transducer or sensing device 

(3) The data processing 

(4) The data feed back 

The next step is to break down the automation of our operation 
into progressive operational steps or elements and mesh the|e with 
our definitions and decide the degree of automation desirable for 
each element. In many process control areas these elements, might be: 


(1) Transport 

(9) Feed back 

(2) Program 

(10) Unload 

(3) Calibrate 

(11) Sort 

(4) Position 


(5) Measure 


(6) Record 


(7) Analyze 


(8) Decision 
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Finally we go back and review our first five questions and four 
definitions and integrate our total knowledge into one single answer - 
the degree of automation we should have for this operation. If we 
wish we can make this three step analysis questions , definitions and 
operational elements - and from it determine a point for process con- 
trol automation on our diagram. If we plot this point as a circle on 
our scaled grid (see fig. 4) we find our total story of process control 
automation available to us in one pictogram, where we note the poten- 
tial process control average index number becomes 50.0* This index is 
Just slightly higher than the process automation itself and should re- 
present no bottlenecking effect. Fig. 4 now is a complete diagram 
against which we can plan our future. At this point we should note 
any upgrading of the process automation beyond that shown which should 
cause us to re-evaluate our diagram. 

The average example we have picked here may not be too far from 
any specific operation you may desire to analyze. Experts tell that 
only 30% of our industrial processes will be automated in the next ten 
years. Many of these processes will only be mechanized as there will 
be no economic reason to do more, or perhaps technical know-how will be 
lacking. In any event much can be done with just what we have avail- 
able today. The accompanying photographs show us what is being done. 

As you will note, these photos show equipments that fit the classifi- 
cation shown in Fig. 2. Such equipments are available from most gage 
manufacturers. 

The examples we have just seen might be called examples of 
dynamic gaging that help produce process control automation. How 
many dollars have you budgeted for dynamic gaging? Have you analyzed 
your need for process control automation? Are you knowledgeable of 
the dollars savings available to you through process control automa- 
tion? When you answer these questions for yourself, you then can 
know and say, *‘For me this is the inspection automation need,** 
Investigate and find out what your inspection automation need is. 
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A MALTING COMPANY LOOKS AT SPECIFICATIONS 
THROUGH STATISTICS 

Robert H, Bauknfcbt Williap i; 

Rahr Malting Go* 

INTRODUCTION 

Our company is celebrating its llOth anniyersary this 
year and the problem of Quality Control probably began the 
first time a consumer asked us to i*make the next wagon of 
malt the seme as the last one". No doubt an effort was made 
to comply with this request wherein our old time artisans 
soon recognized that the solution hinged on not achieving ex- 
actness but on reducing inexactness to an unrecognizable min* 
imum in terms of the consumers evaluation* ;; 

The transition from Quality Control to Statistical Quel* 
ity Control is in most cases a gradual moyement. The^ first 
known application in our industry dates back to the early 
1900* s when William S. Gosset Head Brewer of the Guiness 
Brewery in Ireland^ writing under the pen name of Student, 
reported some interesting deductions^ based on a, statistical 
treatment of his det a* Some 50 years later, statisticians in 
the malting industry and its associated field ebrovlhg” 
again appraising the problems of their endeayors|hro^ 
revitalized vision of Gosset with more and more entht;^siasm 
for the confidence, it gives them in expressing their 'ideas in 
an orderly and effective .manne to the theory 

of statistical treatment of malt house data or why it was not 
more universally applied in its creators „ field du**in0 all 
this time it tomtwhnt^^^ 0 We have S.Q.C* working 

in almost every phase of our operations, in some cases in the 

final status, ..based,,,,., on .,.curre,nt^,',,nee^^^^ ,and,^,,,tn.,,,,.o^^^^ 

starting* This paper is pointed the 

problems we have incurred in meeting specifications ind shov- 
ing how statistics were used, in resqlying the difficulties. 

We hope that in coming years we will hayo the ppportunity to 

present the results of some of the other application^* 

DESIGNING SPECIFICATIONS 

The existence of a Quality Control Program implies that 
s ome type of evaluation has been used to arriye at a .yet of 
suitable standards or specifications by which quality is 
realistically measured. It also implies that confor|iance to 
the specifications can be appraised in some manner. 

A specification, quite simply, is a definition, ; For the 
manufacturer, it defines a quality level which his incoming 
raw materials must meet so that the subseque^ processing 
steps can be maintained in a predictable and controlled 
state* More precisely, the specification states knowledge of 
a permissible range or variation, and that when thiS; range is 
violated it is possible to measure an undesirable effect 
either in units of cost or product quality. For exalipie, 
140-12 s 128 is the only solution to this problem in; mathe- 
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matlca and 132, 125 or 122 are Immediately understood to be 
wrong. No such simple accuracy is available in a malt ana- 
lytical factor such as diastatic power* Who could say, with 
four different laboratories finding 122, 125, 128 and 132 
degrees Llntner on the same sample of malt, which value is 
correct? And of even more importance, would it be possible 
to correlate these four analytical values with any difference 
in the final product? Yet specifications such as, diastatic 
power 126-130°L preferably 128®L are often encountered. In 
other words, there is no cognisance taken of the variation 
involved* 

To get a simple idea of what this variation looks like, 
take a quantity of malt and divide it into two portions, A 
and B* Further, divide A and B into about 20 smaller sam- 
ples* Pick out the malt factors which are considered impor-> 
tant and obtain duplicate analyses on the 20 A samples (the 
first result being called the original and the second the du- 
plicate) and single analyses on the 20 B samples. Then the 
data are tabulated in histogram form to obtain a frequency 
distribution diagram. 

The results of such an experiment for diastatic power 
are shown in Figure 1* The diagram at the top represents the 
total variation or range one could expect from continuously 
sampling and analysing a quantity of malt* To obtain the 
lower diagram for analytical variation, take the results from 
the A samples and for each sample subtract the duplicate re- 
sult from the original result and carry the plus or minus 
sign* The distribution diagrams present a fair picture of 
the variation one can expect. However, a more precise mathe- 
matical definition of the variation can be determined by cal- 
culating the standard deviation and distribution curves. The 
equations are 



where N s Number of values 

i * Glass or cell interval - width of 
abscissa value for each group - 
here 1°L 

Figure 2 shows the frequency diagrams from Figure 1 with 
the calculated frequency curves drawn in* By definition, 68$ 
of all the data will fall within 1 S*D* of the average, 95$ 
within ♦ 2 S. D. and 99.7$ within^ 3 S. D* 

By actually conducting such an experiment, the rudimen- 
tary concepts of variations in malt analytical factors are 
often developed for the first time* Following this, refer- 
ence to many excellent texts provides information on the de- 
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PIGUKE 1 


PRODUCT AND ANALYTICAL VARIATION 
MALT FACTOR; DIASIATIC POVER 


Frequency Distribution For Product Variation 
One Malt Sample Divided For 48 Analyses 


Frequency 


Degrees Lintner 


Frequency Distribution For Analytical Variation 
Difference Between Duplicate Determlnatipns ; 
One Malt Sample Divided For 24 Analyses 
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^- 4 ’ ■ ■-3 - 2 - 
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FIGURE 2 


PRODUCT AND ANALYTICAL VARIATION 
MALT FACTOR: DIASTATIC POWER 


Frequency Distribution For Product Variation 
One Malt Sample Divided For 4^ Analyses 



Frequency Distribution For Analytical Variation 
Difference Between Duplicate Determinations 
One Malt Sample Divided For 24 Analyses 
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sign and analysis of experiments wherein effects of us 
different malts Mn be eyai 

REYISIKG SPECIFICATIONS 

Up to this point we have discussed how statistics are 
used in consider^ug the factors which go into a set of spec*- 
ifications, and this information is m 

requested in establiahing a program of Statisticai Qua^ 
Control. However, in many instances, the specifications are 
in effect and one is faced with the^^^ t "undoing’* some- 

thing that has no meaning and replacing it with^ sound spec- 
ification. For instance, take an occasion where the con- 
sumer * s specif icaticn for color Ldvibond, 

The first shipment of malt against this specification, com- 
prising ten cars, was sent put with tbe co^^ 
range* The average difference between laboratories, as 
shown in the fpllpwing tabulation, was noted when the. con- 
sumer’s data were received, 


Wort Color Data - Degrees Lovibond 


Car 

Supplier 

Consumer 

1 

1.55 

1.80 

2 

1.55 

1.75 

3 

1.55 

1.75 

4 

1.55 

1.80 

5 

1.60 

1.65 

6 

1.55 

1.75 

7 

1.60 

1.80 

8 

1.55 

1.65 

9 

1.60 

1.85 

10 

1.60 

1.70 

Sum (^) 

15*70 

17.50 

Average 

1.57 

1.75 


Average Dlff. (D) « 0.18 

A recheck of the resuljic f^^ control 

data showed that their anaiytical method had not been out of 
control at the time the above shipments were made and a cpn- 
ference with the consumer failed to resPlV^^^ 

The only alternative for the supplier was to establish a hew 
specification for their own shipping department* 

At this point, the human tendency is to say, subtract 
the 0.18®L average difference from each end of the specifica- 
tion and ship 1.32-1. 52®L, but instead of doing thiS| a sta- 
tistical analyses of the data was carried out to determine 

if 8 ■ ■ ' 

1. The 0.18®L average difference observed for qn^^ ten 
samples is significant, and 

2. The ranges or variabilities of the two sets of^^^^^ 
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figures I regardless of their respective levels ^ are 
the same* 

The answers to these two questions are found through the use 
of the statistical tools called the t and F tests* Briefly 
reviewing! the t test is used to determine if there is a sig- 
nificant difference between the averages of two sets of data* 
In this case the 0*18^L average difference tested to be high- 
ly significant thus establishing that there was a difference 
between laboratories* The F test is used to compare the 
variances .present in two sets of data regardless of their 
respective levels* In this example we wish to determine if 
the range or spread of the consumer’s data is comparable to 
the supplier’s even though the two sets average 0*18®L units 
apart. The results of the F test showed that the consumer’s 
data exhibited a significantly greater variance than the 
supplier’s. 

The information obtained from the t and F tests dictated 
that in addition to shipping at a lower level » there could be 
essentially no variation or range allowed* Therefore it was 
requested of the production department that until ve had more 
analytical data for comparison! an endeavor be made to ship 
as close to 1*45^I< as possible* Figure 3 $ which shows a 
graphical history of this case! reflects the effect of this 
recommendation in shipments 11-20* The F and t tests were 
again used in analysing the results of shipments 11-20* The 
difference between laboratories had dropped to 0*13^L and a 
decrease in variance in the consumer's data can also be ob- 
served* 

It is important at this point! digress briefly in ex- 
plaining the position of the supplier’s production depart- 
ment! »8Ly not immediately appreciate all the factors 

involved. In the first place! this particular color require- 
ment! 1*5-1*7^L by the consumer! was not the predominant av- 
erage color desired by the industry and it meant a special 
product had been made* Secondly! malt processing by a sup- 
plier takes place two to four months prior to evaluation by 
the consumer* Where sizable volumes of malt are involved and 
an unusual interlaboratory difference develops unexpectedly! 
one can quickly appreciate the inventory accumulation prob- 
lem* Therefore! in view of the improved interlaboratory sit- 
uation! a series of shipments were planned in the range of 
1*45*~1*55®I*. The results of the next 13 shipments are shown 
as the third period in Figure 3* Six of the cars were found 
out of specification by the consumer and the ratio of vari- 
ances gave an F value discouragingly high* Also! the inter- 
laboratory difference had gone up to 0*2®L* 

Two simultaneous actions followed* First! in view of 
the increased average difference! an effort was again made to 
ship in the very narrow color range of 1.40-1»45®I*. Second, 
a meeting with the quality control department of the consumer 
was requested to discuss the problem* Both actions brought 
results* The analytical data of the additional cars shipped 
in the color range of 1*40-1*45^L during the time the discus- 
sions were going on, are shown as the fourth period in Figure 
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INTERLABOBATOBT ANALYTICAL COMFABISON 



SHIPMENT NUMBEB 





3* ill cars met the consumer's range of 1 *5-1.7®! but the 
extreme variance is again noted* These facts were presented 
to the consumer* He readily recognized that the specifica- 
tion coupled with the interlaboratory analytical variation 
were producing an unnecessary uncertainty* The color speci- 
fication was, therefore, changed to 1.5-l.S®!* Subsequent 
shipments were scheduled in the 1*40-1*55®! range and better 
than 95^ of the cars were then found within specification by 
the consumer's analyses* 

A second example of how statistics were used to undo an 
artificial specification is shown in Figure 4* In this case, 
the specification was on protein ratio and called for a range 
of 39-41$^* The histogram at the top was constructed using 
the analyses obtained by the supplier's laboratory for 45 
shipments* The histogram at the bottom represents the con- 
sumer's analyses on the same 45 cars* Both laboratories av- 
erage 40% but the difference in analytical variation is im- 
mediately apparent* It was recommended to this consumer, 
that because of the differences in analytical variation, the 
specification should be changed to 33*5-41. 5%* The recommen- 
dation was accepted* The supplier continued to ship 39-41%, 
the consumer continues to find the values 38*5-41.5% and both 
are happier. 

In some instances, the characteristics of the raw mate- 
rial dictate to some extent how the specification must be 
written* An example of this can be found in a study of the 
distribution curves for acrospire development such as shown 
in Figure 5* The diagram on the left shows the percentage in 
each growth classification for what would be considered a 
"short grown" malt, the one in the center a "normal grown" 
malt and the one on the right a "long grown" malt. The in- 
crease in percentage in the overgrown classification, as one 
follows from left to right, is an inherent property of barley 
and many other germinating seeds. Hence, a specification 
which calls for an extremely high percentage in the 3/4-1 
growth group and is further qualified with, "overgrown-none" , 
is Ignoring "what comes naturally"* In cases where specifi- 
cations such as this are encountered, curves similar to the 
ones shown in Figure 5 are used to effect a better under- 
standing of what is involved and the establishment of opera- 
ble limits for consumer and supplier. 

The very simplest of cases were used in these examples. 
The problem is multiplied many fold when the supplier is pre- 
sented with multiple specifications, anywhere from 5 to 15 
individual items* The problem is further complicated when an 
interdependency exists in one or more groups of specifica- 
tions. A good example of this is color, diastatic power and 
variety* Color and diastatic power respond in opposite ways 
to the kilning or drying step of malting, color increasing 
and diastatic power decreasing* Yet it is not unusual to be 
asked for low color and low diastatic power and have a varie- 
ty specification which restricts the use of malt having in- 
herently low color and low diastatic power. 
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FIGURE 4 


interlaspmtory ihalytica^ CpMPARlSpil 

PROTEIH RATIO ANAI.YSES OF 45 SHIPMENTS 


Frequency Distribution 
Supplier's Data 
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DISTRIBUTIOM OF ACROSPIRE DEVELOPMENT 
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COHCLPSIOS 

Thare is »ucb excellent collaboratiye work being car- 
ried oiriy coSuMfs and individual 

try aimed at standardising ® The 

agreeable estimates of sample and analytical variation. T 
examples presented here show how a statistical 
"Sfir ... ...d to if 

sound specif ioations. It is hoped, that this paper will 

n:.;;3,‘’a3“no:5t3ic.‘3d't;rf.:iS. .Mtd ...* .....id- 

ered in writing specifications. 
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APPLICATIONS OF SCBEpi 'S METHOD OF PAIRED 
COMPARISONS IN FOOD QUALITY EVALUATION 


0. Dylcstra^ Jr. 

General Foods Corporation 

1. Introduction 

Paired comparisons techniques are being widely applied thrbughoui 
industry. Of the availa,ble methods of analyzing paired comparisons 
experiments, we shall concern ourselves with Scheffers analysis;' of 
variaiice procedure (19^2). ViTe will first review the experimental set- 
up and the mathematics, of the procedure. Then we will des- 
cribe and illustrate. some, of the usual applications of the proc^edure., 

2. Summary of Scheff^*s Procedure 

There are m treatments tp^ M in all M=4a{m-l)/2 possible 

pairs . We obtain 2r observations per pair, r in each order of presen- 
tation. The observations are scored stetementf , of preference between 
pair members and range on a 7*-point scale between ^ 

preference scores are positive if the first member ,of_a.. pair is; p 
ferred, negative if the second member is preferred, and 0 if there is 
no preference. The, points of the scale are described by Scheff^ as; 



Statement on Pair (i,j ) 

I prefer 1 to j strongly 
I prefer i to j moderately 
I prefer i td j sli^tly 

No preference, 

I pref er j to i slightly ' . ^ 

1 prefer j to i moderately • 

I prefer j to i strongly . . 

Considerable. Jlifficulty was encountered when Scheffe «,s i^ie'^hod was 
first applied, but by experimenting with our interviewing technique 
and the wording of the preference statements, we were able to |ind a 
technique which yielded nicely distributed results. 

It should be noted 5-point and 9-point scales may also be 

used. Again, it would be hecessary to establish a proper testing 
technique before using these scales. 

We define the obseryatign on the qrder^^ (i^o) 

and assume all are independent random .yaxiables ^^th mea^ u, , . 

and variance a 

The mean preference for treatment i to treatment j is ^ > ij when 
presented in the order (i,j) and in the order (aji)."^ s-v- 

erage preference/rr' . . and the average^ ^difference due to order |hf pre- 
sentation S y are liven by; 

( 1 ) 2 


Score 

3 

2 

1 

0 

-1 

-2 

-3 
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The average order effect & is given by 
(2) S = I/Xy/(2M), j, 

i«j 

where M equals the number of pairs. 


Scheff^, in his “hypothesis of subtractivity” , postulates that 
there exist parameters 2 > • * • > ^ characterizing the m treat- 
ments, such that the average preference . for i: to J is the differ- 
ence between the corresponding parameters 

(3) ■«y- 0, 

so the “deviations from subtractivity" Y are given by 

(W T-y-iry-Coii-oij) __ 

He adds the convenient assumption, X 

i=l 

The of may be regarded as main effects . 

Since the are random variables, ^ . .1^ is used as the “error” 
in so thaV^ejjjj.* '^iik*" /^ij ' ciAponents which have been 

discussed are summarized below, together with the appropriate stans of 
squares resulting from partitioning the total sum of squares, using 
the analysis of variance table suggested by Scheff 4 ; 


Analysis of Variance 


Source 




Main effects ( j_-" ^j) 

m-l 

Sof 

Of . = 0 

Deviations from subtractivity 

M-(m-l) 

Sy 

Y. 0 

Average preferences (^^4) 

Order effects ( 5 ^^) 

Average order exrect (S ) 

Ml 

(M) 

1 

S^ 

2 tVL ^ 

3=0 


M-l 


5ij-S=0 

Means 



QQgQIll 

Se 


Total 

2 rM 

St 



This table also shows the identities between the sums of squares. To 
complete the analysis of variance we compute the mean squares and the 
F-ratios comparing each mean square to the error mean square. The 
last column has been included to show what the F-ratios are testing. 

The following formulae will aid in estimating the various effects 
and computing the sums of squares: 



Estimation 

Sums of Squares 


r 


/^ij 


2 (r/ly 


2rlVy= r/lij - 

i-'J 
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Effect 




The advantage of using these formulae rather than those given by 
Scheffe arises f row usiJig integers throughout all the computations. 
The remainder of the sums of squares needed for the analysis of ■ vari- 
ance table are obtained by subtraction. 


3. Illustration of the Procedure 

An experiment was run in vdiich there were 5 treatments. The 20 
possible pairingsV considering (i,;)) as different from (j ;,i) wejte each 
tested 6 times. Ihe tasters scored their preferences on the 7-^poiht 
scale described earlier. The 120 preference scores are given in 
Table 1. These are the X. in Scheffe*s notation. The sum of the 
squares of these numbers ^^give the total sum of squares in the anal- 
ysis of variance table. 


Also given in Table 1 are the sums of the preference scores for 

each pairing and represent the 6^. .. The sum of the squares of these 

totals, vdxen divided by 6, give thi^sum of squares for means in; the 
analysis of variance table. 

the 6/^.^ in Table 1 are used to obtain the 121 Tjj and 12 
given in Table 2. " For example, for the pair (1,2) , . 

12 T>^ ‘ 3-5= -2 
12 “ 3 + 5 = 8 = 12 3 2^ . 

For pair (1,3) 

12 = lb - 2 = 12 ^ 

12 5-^2 - lit + 2 = 16 = 12 3 ^ 3 ^ . 

. A 

As j^emonstrated, one table may be used to list both the 12 Tr. . iand the 
12 In the analysis of variance table, the sums of the i^uares of 

these*^ numbers, when divided by 12, give, respectively, the sum of 
squares for average preferences and the sum of squares for order 
effects. 


The sum of all the , or the sum of all the 6yCk-. or the sum 
of all the 12 when divided by 120, gives in the aniSysis o:f vari 
ance table the ^'^sum of squares for the average order effect. 

As shown in Table 2, the 12 tr. . are combined to give the 60 ^ . 
Thus: ^ ^ 

for treatment 1, - 2 + lU + 11 + 12 =3$ = 

for treatment 2, -(-2) +1 + 10 + 9 = 22== 60o| g 

for treatment 3, -(lU) - (1) + 10 + 1^ = 10 = 60o(^ (Cont*d.) 
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for treatment U, -(11) - (10) - (10 ) - 3 = -3U = 6o of 
for treatment -(12) - (9) - (15) - (-3) = -33 = 60 6j 

In the analysis of variance table ^ the sum of squares for main effects 
is obtained by squaring the 60cfj^ and dividing their sum by 60. Note 
that the 60oj j^ sum to Oo 

The remaining entries in the analysis of variance table, shovm as 
Table 3, are obtained by subtraction o We can see that only the mean 
square for main effects is significantt 


'Hius far we have not concerned ourselves with the m treatments o 
They might have represented m brands of a product, as in this case. 
They might have levels of a multi-level factor, for which we want to 
determine the optimum level. Furthermore, they might have represented 
factorial combinations. Each of these three applications will be dis- 
cussed in the following 3 sections of this paper. 

Ij. . The Treatments are Brands of a Product 

We have illustrated the computations of the Soheffe procedure 
with an example in which 5 brands of a product were compared. We have 
obtained the average preference scores ( and wish now to decide 
which is best, etc. 

The variance, between two average preference scores is 

(5) V( - efj) = cVrm, 

where there are r judgments on each of the m(m-l) pairings of m treat- 
ments. In the present example V(o(^ - oj.) ».ril, so that the standard 
deviation of the difference between^ two average preference scores is 
.33 . We now use some multiple comparisons technique to decide vuhich 
brands differ significantly in preference. 

5. The Treatments are Levels of a Multi-Level Factor 

We have a formulation which is fixed with respect to all but one 
of its ingredients. This ingredient may be the amount of sugar, the 
amount of color, etc. We usually have done some preliminary work and 
know what amount is too little and what amount is too much. Tile opti- 
mum vdiich we are after will, therefore, be somewhere between these ex- 
tremes. We will run the two extreme levels and one to three intermed- 
iate levels. It will be best to select the levels so that they are 
equally spaced in some system of iaeasurement. 

To determine the optimum we must deteimne what order polynomial 
will adequately describe the o( We set up the usual regression mod- 
el and define the orthogonal contrasts for linear, quadratic, etc., as 
^ m ^ m 

(6) ©1=2 Oii 2 C.. = Oj j=j,, m-l; and 

^ 1=1 1=1 

m 

°jl °kl ° k. 
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The sum of squares for main effects . is partitioned into com- 
ponents , each vjith one degree of freedom, with each contrast ,0. 
tributing ■ ^ 

(7) 2m©^/| = [l Cjj^(2nnS(^) ]V(2im) I ; 

to • These sums of squares are tested against the experiiiiqptal er- 
ror to determine their statistic|Ll.si^^ Only those;:©, which 

are significant are used tp estimate th^ ; ^ 

The estimates of the are given by 

(8) E(S(.) = I CjiCVf 

and the variaaace of i^ese est^^ 

(9) v[E(£|i)] = ^ I 

where the suramatipn. over j extends to only as many terms as are sig- 
nificant. 

The optimum level is found by differentiating (8) with respect to 
the original variable. The derivative is set e to zero ^d solved 
for the optimum. If the optimum is not one of the levels which we 
have run, we do not have an exact formula the 'V^iance 

of the optimum. A suggested approximation is 

2 

(10) V [m«c B( Pf ] = ~ I [(ojq)VI ], where ttte are 

found by inserting the level at which the optimum occurs into the for- 
imlae for the Cj^. 

To illustrate the procedure, we have used an experiment ‘in which 
there were 5 equally spaced levels of sugar. There were 18 Judgments 
on each of the 20 pairings. In Table U are given the 2rmof,«l8o 
the for the linear, quadratic, cubic, and quartic components 
(i.e., j=l,2,3, and i^., respectively). The ^ ^ , their respective sums 
of squares, and the F-ratips based on the experimental variance of 
2.83 are given. We find that only the linear ^d quadratic terms are 
significant A so that we can express the cf, as csj . .. .6802 -•-.r05U(i-3) 
-.3U01(i-3^'^. This yields a maximum for i=> 3*16^ at which level the 
predicted^, is .69. The variance of the prediction is (.0670)^ for 
1*3 and (.0519)^ for i«i|. Based on equation (10) we might guess that 
the variance of the optimum is (.0655)^* 

6. The Treatments are ...F.ac.t,prial.. ..,Cpmbinatip,ns... . 

The procedure described above may easily be extended to^ apply al- 
so to factorial designs. We treat the qf. as our observations- as we or- 
dinarily do, but all the resulting sums^of squares must be multiplied 
by 2rm. If the 2rmoJ^ are used as the obseivations , then the sums of 
squares must be divided by 2rm. These sums of squares are, of course, 
a partitioning of the main effects sums of squares in the analysis of 
variance table. 

In the case of 2^, factorials or fractional factorials 
equal plus or minus i, so that the factor effects are given by 
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0./m, which has variance 
J 

(11) Var( ©^/m) = oVsrm^ , 

vi^ich is l/(iQ“l) times the variance of the . 

To illustrate the procedure we have selected a 2x2 factorial, in 
whibh there were 10 repetitions on each of^ the 12 pairings of the U 
factorial combinations. The values of 80 are given in Table 5, 
where the factorial contrasts are also given. The F-ratios, obtained 
by dividing the respective stams of squares by the experimental error 
variance of 2.98, indicate that both the factors are showing signifi- 
cant effects on preference and that the interaction term is negligible. 

7. 


We have reviewed the mathematics of the Scheffe method of paired 
comparisons and have illustrated the computational techniques. We 
have discussed and illustrated the application of the procedure when 

a. the treatments are brands of a product, 

b* the treatments are levels of a multi-level factor, 

c. the treatments are factorial combinations. 

By extending the ideas given in this paper it would be possible to ap- 
ply the Scheffe procedure to the response surface type of design. 

This type of design is analyzed by regression analysis, and we note 
that applications b. and c. are relatively simple regression problems. 


Reference : 

ScheffI, H. (1952). An Analysis of Variance for Paired Compari- 
sons « tJ .A • S .A . , 1(^7 3 381 » 
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Table Summary of Preference Sco3?eg 


Treatment (j) 


!ireatment (i) 



3 

5 

—Tzn 

1 


■auQ 

ISH 

3 2 0 
13-1 

8 

■MWMM 

BBI 

bBBB 

BS 

2 

2 ^2 1 

3 10 

5 


H 

um 

■H— 

HSI 

3 

mnmmKm 

BIB 

■laraBM 

H 



2 , TT 
3 3 0 
11 


BM 

BBEB 

b -i -2 
-3 3 -2 
-6 

■ 

||HB||||K| 

mm 

5 


jgjjgllQ 

-I - 3 ""cr 

3 -1 -2 

■1 



Note: 1. 


2 , 


3. 


The cells SHOW Xyg ^^3 
"ij? "ij6 


The judges < preference 
scores. 


The preferences are scored; 


6 u. . The sum of the scores for 

^ a given i and j, when i is 

tasted before j, tr 
3 - strong preference: 

2 - moderate preference 
1 - sli^t preference' 

0 - no preference , 


The preference scores are positive if the first S|||Dple 
tasted is preferred and negative if the second sample is 
preferred. 


Table 2 1 Finrther of Preference Scores^ 


SBSBSHf 

^ v"',T Tre 

■P 

1 

T31 : 


60 

Avg.Pref . 
Score (% ) 

I 


3 1 

HKflIi 

3 

I 


-2 



12 

33 

.$8 

2 

8 


■n 


9 

22 

.37 

3 

2 

-7 


BB 

13 

10 

.17 

h 

-1 


~2 

HH 

-3 

-3h 

-.37 

S 

-6 

13 

7 

■n 


-33 

-.33 


* =» . are given in^the portion above the diagonal. 

These'^are combined^tp^ the 60 column. 




are given in the portion he^pw thf 
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Table 3, Analysis of Variance 


Source 


S.S. M.S. 


Main Effects 
Deviations from 
Subtractivity 


k 67. SI 16 . d9 

Ui.is 2.36 


F- 


Average Preferences 10 

Order Effects 1CH<* 

Avg, Order Effect 1 

Differences among 
order, effects 


81.7? 

37.U2* 

3.68 3.68 

. .JjJl 


Means 

Error 


Total 


20 119.17 

122- 

120 1;53 


* Not included in the totals because of partitioning of the 
degrees of freedom and sums of squares . 


■ratio 

?.06 

>71 

1.10 

1.12 
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Table U. Illustration for a Multi-Level Factor 


Coefficients 


1 180 qfi 





1 -156 

-2 

2 

-1 

1 

2 3k 

-1 

-1 

2 

-1; 

3 no 

0 

-2 

0 

6 

it 105 

1 

-1 

-2 

-it 

5 -93 

2 

2 

1 

i: 


197 

-857 

-79 

-11*5 

IBoZ oj. 

1800 

2520 

1800 

12,600 


21.56 

291-1*5 

3.k7 

1.67 

F-ratio 

7.62 

102,99 

1.90 

•59 


i 

Table 

• Illustration for 

a 2 X 2 Factorial 

Treatment 

Combination 



°.ii 


ff-effect 

B-errect 

interaction 

1 

(1) 

-61 

-1 

-1 

1 

2 

a 

12 

1 

-I 

-1 : 

3 

b 

-32 

-1 

1 

-1 

h 

ab 

81 

1 

1 

1 

II 

<<D 

0 ji(80 Sl^) 


186 

98 

ho 

Dj= eolcjl 


320 

320 

320 




108.11 

30,01 

5.00 

F-ratio 


36.28 

10.07 

lia 
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THE CU ITOGRAM IN 

T*G* Moser 

Ciril Aeronautics Achsdnistration 

Ciuality requiremeiyts increase in dlxoct^ p to speed and 

conjplexity of the aircraft. Higher speeds and temperatures, nru<^ 
greater power in terms of horsepower and thrust, higher wing loading 
and faster landing speeds are taxing available laaterials to the limit. 
Each part must cariy its portion of the load and do it close to i'^s 
limit load. Defects obviously become less tolerable. Inspectidn 
techniques must ke^ step to assure sound parts • 

Less than 40 years ago aircraft speeds were in the order of 100 
mph. Today we consider 550 mph commonplace. Furthermore, the science 
of Astronautics is rapidly being developed. A pregnant question se^as 
to be, "Is the art of quality conta?ol keeping pace with this increase 
of speed in flight?" 

The answer to that question may very well come frOT the cpijib^ 
efforts of men in this conference^ It is a well-known fact tha^ there 
is a tremendous backlog of orders for civil aircraft prod\aots. It 
occurred to me that the subject of "The CAA Program in Quality Control" 
would be of particuiar interest to you at this time. 

In the early days of avlatipn it became apparent to those in in- 
dustry and the Congress of the United States that if civil aviation 
was to progress and take its place among the accepted methods or trans- 
portation, it must be safe. The Air Commerce Act of 1926 was the first 
federal lav regulating civil aviation. This law was modernized!, by the 
Civil Aeronautics Act of 1936. This Act as amended established two 
civil aviation agencies with separate areas of responsibility. First, 
there is an agency known as The Civil Aeronautics Board, one of , whose 
functions is to issue the Civil Air Regulatio-ns. Then there isi the 
Civil Aeronautics Admirdstration which has a wide variety of responsi- 
bilities in the aviation field, including such things as enforcMient of 
safety regulations, ev^mting new aircraft from a safety standpoint, 
licensing airmen and helping municipalities in^rcve their airpoHs. 

Enforcement of safety regulations aisd evalwting new aircr^ ft*om 
a design and manufacturing standpoint puts the Civil Aeronautics Admire 
istration in the field of quality control. Quality Control is synony- 
mous with safety, and safety la CAA »s prime objective in the program: for 
the promotion and advancement pf civil you know, bafety 

does not "Just happen". We in CAA reco^ize and appreciate the valuable 
contribubion of groups such as this which have advanced safety in civil 
aviation to where iiti is ^ ^ ^ ^ 

For the purpose of this discussion we will co^ 
sponsibilities as they apply to the design, cohstructSbn, quall't^^ con- 
trol, and certlfioatipn of aircraft products. From the time 
a new aircraft is on the drawing board CAA, through its office; of Flight 
Operations and Airworthiness, works to assure its safety. First c<maes 
cooperative effort with the manufacturers to see that an ample margin of 
safety is built into the vehicle itself . 

There are three basic certificates wM CAA issues to signify 
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that industry has met the pertinent requirements# These will be dis- 
cussed in chronological order. 

First, there is the type certificate, which is a document indicat- 
ing that the design of the product meets the requirements specified by 
the Civil Air Regulation# In order to obtain a type certificate, the 
manufacturer must first submit data to CAA that defines and discloses 
the configuration and performance of the airplane, engine or propeller# 
This includes drawings, specifications and test reports# 

Second, a production certificate is a document issued to a mazni- 
facturer when he has demonstrated to the CAA that he is consistently 
capable of producing articles with adequate quality control conforming 
to the approved type design# This involves an examination of the manu- 
facturer's facilities by a group of specialists# They will determine 
that the manufacturer has adequate written procedures on all the salient 
facets of production, trained personnel and equipment to assure produc- 
tion that meets required quality and safety standards# 

Third, an airworthiness certificate is issued for an aircraft as 
evidence that it conforms to CAA approved type design and that it is 
safe for operation# Bach CAA approved aircraft is issued an aiivorthi- 
ness certificate which remains in effect as long as the aircraft is 
maintained in accordance with the Civil Air Regulations# 

The regulations that CAA administers are based on facts gained 
throtjgh service experience over the past years. They are based on 
facts, not opinions# The aviation industry has provided many of the 
facts around which regulations have developed. Industry has contributed 
in a large measure to the drafting of these regulations* Before new 
regulations are adopted they are submitted in the form of a proposal to 
the aviation industry for comments on whether compliance is economically 
feasible and whether in their opinion the safety objectives proposed 
will be attained# Joint meetings are held in which the CAA, the CAB and 
industry representatives all have a part in drafting of the final regu- 
lation# From this viewpoint then the CAA is an enforconent agency en- 
forcing Civil Air Regulations idiich have largely been developed in co- 
operation with the industry* 

The Aircraft Engineering Division is a segment of the CAA whose 
responsibility it is to evaluate new civil aeronautical products for 
ccmplianoe with regulations and for eligibility of the product for CAA 
certification# Safety, airworthiness, and reliability are the prime 
considerations for certifications# On the staff of the Aircraft Engi- 
neering Division are such specialized personnel as structural engineers, 
aerodynamicists, vibration specialists, power plant engineers, propeller 
specialists, test pilots, flight analysts, and manufactiiring quality con- 
trol specialists# 

It Is their responsibility to evaluate the product presented hy 
the manufacturer to determine whether it meets the requirements of the 
Civil Air Regulations. This staff of specialists also evaluates the 
testing programs proposed by the manufacturers in connection with new 
designs, new materials, and new processes. Processes and procedures 
are carefully evaluated in factories, and it is in this evaluation that 
qtiality control systems come under CAA examination. There is a signifi- 
ecuxt difference between qruality control from the viewpoint of the mam- 
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factnrer and quality control as it concerns CM* In addition to ^ 
the mannfactiirer's quality control is concerned with such thiiiga an 
customer acceptance, price, eye appeal, etc* The CM is concerned only 
with those quality characteristics that affect safety* It is a CM re- 
sponsibility to ascertain that production and quality control sil^stems 
are adequate to produce duplicates of articles cpnf onning to the 
approved type design* 

The Okk has endeavored to develpp a small efficient staff of 
quality specialists to coyer all manafactxirers producing civil Mrcrafb 
products such as aircraft, engines and propellers* It is obvious ttet 
with a small group of people we cannot expect to conduct a detailed 
inspection of all prodixcts inyplyed*^^^^^^^!^^^^ we must depend on our 

system of evaluation of a ir^ufacturer*s procedures and quality control 
system* 

A great deal of thought has been devoted to the problem of how we 
can utilize our personnel most efficiently in accomplishing our re- 
sponsibilities for yerifylng continued compliance on the part o^ the 
manufacturer* It has been found that the facilltifa of co2i|)ai^ 
producing aircraft products can be subdivided into functional ai*eas* 
These areas are then eyaluajied periodically and systematical^ 
use of survey reports, control charts and follow-up* In conducting 
these evaluations, we make a determination of six items which are 
canaaon to every type of area, regardless of function* These items in- 
clude: personnel, facilities, technical data, product conformity, 
records, and general cou^liance* Our experience has shown that, the use 
of this suryeillance system will furnish us the mpst accurate pvaluat|.pn 
of the manufacturer's operation with a minimum of man-power* We do not 
duplicate the manufactiirer^s quality control syst^, but verify the re- 
sults of his system* 

Service records provide a barometer ^d addit tool fOT evalu- 
ating the quality of a manufacturer's product* Service dlffici^ty in- 
formation comes :^om many sources including airline operators, accident 
reports, and thrpt:igh our system of malfunctioning and defects Reports* 
Malfunctioning and defects reports are submitted by aircraft owners, 
operators, mechanics, and by our field personnel* This inform 
assmbled by our Washington office where it is analyzed for statistical 
purposes and appropriate action* 

As the industry has grown and demonstrated its ability and willing- 
ness to assume more responsibility in the field of safety regulatibhs, 
the CM in tuTO has delegated additional authority to industry as pro- 
vided for by the Civil Aeronautics Act* In this connection, qualified 
industry personnel may be authorized to perform certain functions on 
behalf of the CAA, under CAA supervision* In so doing they ma^ be 
authorized to approve aeroxiautical products including airworthiness 
certification of aiiHsraft un^ the staMards established in the Civil 
Air Regulations* This provides certain benefits to both the m|nu- 
facturer and CAA in that around-the-clock service will be available* 

This releases CM personnel from these duties which will permit them to 
more effectively perform other functions* 

At this point it shpuM b^jaiaphasi^^ that CM has not relinquished 
its responsibility for assuring safety* 
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Industry* personnel appointed to perform CAA functions must first 
meet rigid qualification standards* After they are selected they are 
given on-the-job training and furnished vdth all necessary regulations 
and operating instructions* Their performance is subject to continuous 
evaluation by GAA personnel* 

In order to give you an idea of the magnitude and progress of the 
civil aviation industry, I will quote a few statistics ooD^lled by GAA. 


Registered civil aircraft 

1955 

1956 

Percentage 

Increase 

Manufactured 

4820 

7205 

49. 5? 

Civil airframe weight 

10,230,500 

16,055,900 

56.956 

Civil engines 

7639 

11,501 

50.656 - 

Civil exigine (h*p*) 

3,338,400 

5,656,600 

69.556 


On June 30, 1956 there was a total of 83,641 civil aircraft registered 
in the U* S*; 63,092 were what we call active aircraft* 

As you can see from these statistics, the importance of the civil 
aircraft industry has reached major proportions* I believe that im- 
proved quality control methods, plus the increased interest in quality 
control by management, has played an all in^ortant roll in the amazing 
progress of the indtistry. 

The Civil Aeronautics Act was designed not only to assure safety 
in air transportation, but also to promote aeronautical development and 
experimentation* For this reason the Civil Air Regulations are written 
objectively* Since the GAA is not the customer, the manufacturer is 
given wide latitude in the design and laanufacture of his products, pro- 
vided the minimum standards of safety are met* 

It is a fundamental policy of GAA to encourage Industry to develop 
effective methods of quality control which will assure continued growth 
of the industry throu^ improved safety* 

It is my opinion we too often consider quality conti*ol as a non- 
productive facet of production* The aircraft industry is a mature 
industry, and is the largest industrial employer in the U* S* I am 
sure you will agree experience has demonstrated that quality is the 
cornerstone for a dynaaod-c and safe civil aircraft industry* 
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VARIABILITY OF MEpHAHICAL PROPERTIES OF FLAT ROLLED SHEET PRpDUCT 

John V. Sturtevant 
U. S. Steel Corporation 

Variability of mechanical properties of flat rolled metal product 
is a matter of keen interest, not only to its fabricators, but 4iq.ually 
to its producers who are constantly working to improve the unif cirmity of 
these properties. Under t|te impetu increased scientific knowledge 
of the nature and behavior of metals, our modern equipment, technology, 
and instrumentation have been combined by alert management to provide 
degrees of uniformity which are markeaiy superior to those previously 
attained. These efforts continue, for it is well recognized that the 
fabricators* interests are best served by products having mechanical 
properties whose variabilities are at the minimum levels consistent with 
sound economic practices. Contributipns of the technical and production 
staffs of the fabricators* plants must be equally recbgni zed, fpr 
without their enthusiastic and whole-hearted cooperation, much pf the 
progress which has been made to date could not have been accomplished. 
This splendid spirit of cooperation is most heart ehing and, as It member 
of the Metals Technical Committee of ASQC, I welcome this opportunity to 
make some small contribution toward a better appreciation of the 
variabilities found in the mechanical properties of flat rolled ^ 
product. ■ ■■ 

Before proceeding with the details of this study, I wish to explain 
that this paper is one of a series which is being sponsored from time to 
time by the Metals Technical Committee with the aim of improvir^ our 
mutual understanding of this general problem of variability in 
mechanical properties. In view of the broad scope of this field, 
however, it appears preferable to consider only one property arid product 
at a time. Accordingly, at the Montreal Convention in 1956, 

Dr. John W. W. ^llivan presented a similar paper concerned with the 
Rockwell hardnesses of steel sheets.! Although our present study is 
again concerned with a steel product, I wish to emphasize that the 
Metals Technical Committee is keenly aware of the existence of similar 
problems in the nonferrous field and hopes, in the future, to bring 
these before you. :: 

Our present study concerns the variabilities found in Olsen 
ductility cup tests made on 25 sheets of rimmed steel taken from the 
middle of the lengths of 25 coils rolled straightaway on a conventional 
mill. It is important that we clearly recognize that the uniformity 
found among these test values if substantial than that which 

can generally be e^qiected of such product since, fir it, the specimen 
sheets represent only one position with respect to coil length, second, 
the slabs from which^^ t^ were rolled were substantially similar 

in chemical composition and third, the coils havliig been foiled at the 
same time, were subject to the same processing conditions. 

In making the Olsen ductility test, a small specimen is cut from 
the sheet and held in position over a die while a steel ball fs steadily 
pressed into the specimen, forming a small cup. The test value is then 
recorded in mils as the depth to which the ball has been forced when 
incipient fracture is indicated* Since we are concerned in tills study 
only with the variability found among these test values, it has been 
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FIGURE i - Schematic Uy-out of Specimen Sheets Used For Ductility Cup Tests 


Percentage Distributions of Individual Values Arranged by (1) Position 
Along Lengths of Sheets and (2) Across Widths of Sheets 

Positions Along Sheet Length Positions Across Shpet All 


L-1 

L-2 


L-4 

1=1 

Mils 

T-l 

T-2 


T-4 

.Irl 

Values 

0,8 

1.6 

4.0 

1.6 

1.6 

< 1 



4.8 

1.6 

3.2 

1.92 

0.8 

5.6 

5.2 

4.0 

5.2 

1- 5 

2.4 

3.2 

2.4 

4.0 

4.8 

3.36 

9.6 

8.8 

8.0 

5.6 

5.6 

6-10 

4.8 

8.8 

12.0 

.10.4 

1,6 

7. 52 

11.2 

i6.0 

15.2 

11.2 

10.4 

< 11 

7.2 

12-.0 

19.2 

16,0 

9.6 

12.80 

20.0 

16.0 

21.6 

18.4 

15.2 

11-15 

12.0 

25.6 

24.8 

20.0 

8.8 

18.24 

20.0 

21.6 

19.2 

20.8 

23.2 

16-20 

16.8 

16.8 

30.4 

20.8 

20.0 

20.96 

16.8 

21.6 

20.0 

19.2 

24.0 

21-25 

21.6 

24.0 

12.8 

18.4 

24.8 

20.32 

19.2 

13.6 

15.6 

14.4 

16.8 

26-30 

24.0 

12.0 

8.0 

12.8 

20.8 

15.52 

76.0 

72.8 

74.4 

72.8 

79.2 

11/30 

74.4 

78.4 

76.0 

72.0 

74.4 

75.04 

12.8 

5.6 

6.4 

14.4 

8.0 

31-35 

13.6 

8.0 

4.0 

9.6 

12.0 

9.44 


4.8 

4.0 

1.6 

1.6 

36-40 

4.8 

1.6 

0.8 

0.8 

4.0 

2.40 


0.8 



0.8 

> 40 




■ 1.6 


0.52 

12.8 

11.2 

10.4 

16.0 

10.4 

> 30 

18.4 

9.6 

4.8 

12.0 

16.0 

12.16 
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possible to simplify the presentation by considering, for each test 
specimen, only the number of Mis by which the actual test value V exceeds 
a constant reference value/ te these ’’coded” values range from 
(minus) -20 through plus k2 mils, i.e., through an over -all rah^je of 
63 mils. 

Turning to Figure 1, we find the schematic layout for the prepa- 
ration of the 625 individual Olsen ductility specimens. It is lioted 
that each sheet was sheared to a length equal to its width and then 
sheared into five intersecting rows and columns. The rows, designated 
as L-1, L-2, etc., progress in the direction of rolling while the 
columns, T-1, T-2, etc., progress from left-to-right across the ;Mdth of 
the sheet. As a result, we can consider the five test values r^re- 
senting each of the five rows and five columns as a group of size n =* 5- 
Further, on passing along the series of 25 sheets, we also have ;a series 
of 25 L-1 groups, 25 L-2 groups, etc., and a similar series for the 
T-groups. In addition, each of the 25 sheet positions (such as;;L-3/T“2) 
can be considered as providing one of a series of 25 test valued 
respectively representing the 25 coils. Thus, it is evident that we 
have several bases upon which to consider variahillties, not only among 
the individual Olsen ductility test values, but also among their group 
averages, ranges, and standard deviations. 

Turning to Table 1, let us first note the per cent frequency 

distributions of the individual vMuei as arranged in accordance with 

the five row positions (L^) and the five column positions (T^). Here we 
note in the fourth line from the top that, while the frequencies of 
values below 11 Mis for the L-2 and L-5 rows differ by 5 * 656 , the T-1 
and T-3 columns differ by I 2 .O 56 . At this point, let us turn to 
Dr. John W. W. Sullivan Vs paper on Rockwell hardness given at ttie 1956 
Convention.^ With his kind permission, I quote in part: ’’Rimmed steels 
are characterized by marked differences in chemical cpmposition'across 
the section and from top to bottom of the ingot. They have an Suter rim 
that is lower in carbon, phosphorus, and sulphur than the 4tvefa|e 
composition of the whole ingot, and an inner portion or core that is 
higher than the average in those elements.” — --"The structural /^t tern 
of the rimmed steel Ingot persists through the rolling process |o the 
final product.” Thus we see that the centers of the widths of steel 
sheets taken from coils rolled in a direction parallel to the heights of 
their parent ingots must be expected to have carbon, phosphorus/ and 
sulphur contents higher than those found near the edges of the sheets. 

Sine e incr ea sed c ont ent s of the s e element s t end to r educ e duct i jj-ity , the 

relatively higher frequency of the lower Olsen ductility values-' in the 
T-3 columns (Table 1 ) is to be expected. Thus we see that, on; passing 
from edge to center of the sheet, an inherent technical characteristic 
of this widely-used type of steel constitutes a source of yaria] 5 )ility in 
the ductility test values. Upon passing from row-to-row along the 
length of the sheet, however, a lesser variability is to be expected 
since the total length of a single sheet constitutes but a very small 
increment of the total height of the parent ingot as poured. 

In view of the differences noted in Table 1 among the frequencies 
of "low" (below 11 mils) and "high” (above 30 mils) test values; found in 
the various "T" columns. Table 2 was prepared in order to exhibit these 
frequencies as they occur from coil-to-coil. In order to simplify the 
presentation, these frequencies are presented by count rather tiian in 
the form of percentages. Here we find that, despite their siMlarity in 
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Table 2. 


Frequency by Count of Low* and High** Values Arranged by Position 
Across Widths of Sheets and by Coll 


Under 11 Mils* 

IrL 1=1. l=i£, .1=5 T-Ali 


Coll 

Jia^- 


Q,Y.gr 39 

IdL IzL l=i X=iL Jti 1=AA.I 


1 1 


1 3 



2 13 

1 2 3 

2 2 

1 2 


1 

1 

1 

2 


1 

4 

1 

1 

2 


114 
4 4 16 

1 2 5 

1 
4 


6 

7 

8 
9 

10 



1 1 


2 

2 


4 3 

3 2 


4 1 12 

1 6 


2 111 
3 1 


5 

4 


11 

12 

13 

14 

15 


2 


1 


1 


1 


3 5 

1 1 

12 4 


16 

17 

18 

19 

20 


I 13 3 


1 


21 

22 

8 23 

24 

1 ^ 



9 


13 24 20 12 80 


23 12 6 


15 20 76 
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TalBJL g 1 


Frequencies by Count of 5>Value Averages Arranged by (1) Position 





Along Lengths of Sheets 

and t2) Across Widths of Sheets 




Position Along Sheet Length 




Position Across Sheet Width 
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2 
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7 

5 
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3 

2 

11 
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2 

2 

8 

22 

22 
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19 
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21 

■ 

10^ ' 

2 

"''3 

3" 




13 

31-55 

3 

......g... 


......g . 

2 

9 







36-40 













> 40 







2 

3 

3 

3 




3 

''^■■"‘''■2 


"■' 2 '' ' 

2 

9 




xmsJL 

Frequencies by Count of ^-Value Ranges Arranged by (1) Position 
Along Lengths of Sheets and (2> Across Widths of Sheets 


Position ^ Al<^ Jheet ^ _ __ — . PoBitiQni ,., Adl!OSft Sh . est W4flth 


kjL 

icL 



:...■ 

"1-m 

Mils 
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T-4 
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4 

1 

2 
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9 

7 

5 
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15 

7 

44 
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6 

13 

13 

6 

11 

49 

8 
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58 
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5 

1 

4 

3 

6 

19 
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1 

3 

2 

10 

3 

19 

3 
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2 

1 

8 

21-25 

1 

2 


1 

3 

7 

1 

1 


1 


3 
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2 

4 

17 

15 

13 

6 

18 

71 

uTfo 

15 

11 

8 

17 
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Frequency by Count of Individual Values Arranged by Row/Column 
(Li/Ti) Positions on Sheet 


Row Column 


L 

Mils 

T-1 

T-2 

T-3 

T-4 

T-5 

T-All 


< 11 

1 

3 

6 

3 

1 

14 

1 

11/50 

20 

21 

17 

19 

18 

95 


o 

A 

4 

1 

2 

3 

6 

16 


< 11 

2 

3 

5 

5 

5 

20 

2 

11/50 

18 

19 

20 

18 

l6 

91 


o 

A 

5 

3 

0 

2 

4 

l4 


< 11 

3 

5 

5 

4 

2 

19 

3 

11/50 

l8 

18 

19 

18 

20 

93 


A 

O 

4 

2 

1 

3 

3 

13 


< 11 

1 

1 

4 

5 

3 

14 

4 

11/50 

20 

20 

18 

16 

17 

91 


V 

o 

4 

4 

3 

4 

5 

20 


< 11 

2 

3 

4 

3 

1 

13 

5 

11/50 

17 

20 

21 

19 

22 

99 


> 30 

6 

2 

0 

3 

2 

13 


< 11 

9 

15 

24 

20 

12 

80 

All 

11/50 

93 

98 

95 

90 

93 

469 


o 

A 

23 

12 

6 

15 

20 

76 


Table 6 

Frequencies by Count of Averages of Croups of Twenty-five 
Values Representing (1) Entire Sheets and (2) Row-Column Sheet 
Positions (Li/Ti) 


Mils 


Entire 

Sheets 


Row -Column 
Positions 


<11 2 

11/15 3 

16/20 8 

21/25 9 

26/30 1 

>30 2 


0 

2 

13 

10 

0 

0 
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chemical composition. Coils Ho. 10 through l4, l8, 20, and 23 display no 
test values abQve 30 s while Coils No. 22, 24, and 25 show a 
preponderance of Suph;m Thus, it is clearly evident that .^yen 

with the diligent care which is exercised by the technical and 
production staff s of the producing mills, variability in ductility test 
values must be expected on passing from coil-to-coil. 

VJhen variability is encountered among individual data, it is, of 
course, customary to consider the possibility of using averages of 
groups to represent more adequately the characteristic being studied. 

With this aim, the averages of the groups of 5 values representing the 
rows and columns on the 25 specimen sheets are listed, ih Ta 
form of frequencies by count. While the differences are not outstanding, 
the T-3 column should be compared with the other "T" columns wi-tjh 
respect to its fre<iuencies of test value averages below 11 mlls^and 
above 30 mils. Here/we find that effect of the “ 

averaging process yet reveals the tendency of the center of the^'sHeet 
width (T-3 column) to exhibit somewhat, lower ductility values. ^Turning 
to the question of the ranges of these same groups of 5 values, it is 
interesting to note in Table 4 that column. T-3 <51 splays some tendency 
toward both 'Vlow" and "M ranges as compared with the other JT” 
columns. The teclmical signif ica^^ of this double tendency is not, 
however, clear. 

Returning to consideration of the individual values. Table 5 lists 
their frequencies by count as arranged by their row/column positions 
(L;L/TjL) on the 25 specimen sheets. Here it is evident that there is no 
single position which displays an outstanding frequency of "low" or 
"high" test values, instead, as previously indicated in Table 1, the 
effect of position across the sheet width (T-columns) strongly Over- 
shadows that of position along the sheet length. 

Table 6 presents the frequencies by count of averages of groups of 
25 values arranged in two manners, those representing entire sheets 
without regard to the rows and columns qf ludlyidnal test^^, s and 

those comprising row/column sheet positions (Li/Ti). A comparison of 
the two significant columns listed in this indica-les that 

greater variability is to be expected among, the sheets taken 
different coils than among the row/column positions used in the^test 
Specimen layout, H 

The use of statistical control ^c^ is always An 

intriguing possibility in working with data of this nature. Let us, 
then, examine this set of 625 test values with respect to their;; 
statistical unifpjTmity in the sense of Shewhart. Considering fj-rst the 
10 row and column groups of size n = 5, we find, in Table 'J , the 
conventional control, gfert s^ for each of the "L" and "T" groups. 

Turning next to Table 8, we find iisted the seyeral group^^'a^ which 

fall near or beyond the 3-sigma limits given in Table 7* Since these 
averages are arranged with respect to their coil numbe^^^ it is 
interesting to note that nearly all of the averages representir^ Coils 
No. 11, 22, 23 , 24, and 25 lie beyond either the lower or upper; iimits. 

It would, of course, be tempting to exclude these groups and recompute 
the control chart limits, but to do so would not be consistent with 
sound statistical principles for we are not in a position to designate 
their assignable causes and, further, there would yet remain ll! coils 
displaying averages as yet unexplained. 
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Table 7 


Control Chart Statistics for Croups of Five Values Taken (1) Across 
Widths and (2) Along Lengths of Sheets - Expressed in Mils 


Statistics Computed 


(* 

- 3 - Sigma) 


Across 

Sheet 

Width 



Along 

Sheet Length 



Statistic 

1 =L 

L*.2 

h=l 

L-4 

kl. 

T-1 

T-2 

1 = 1 . 

T-4 

Izl, 

f 


20.7 

19.8 

19.0 

20.7 

21.0 

23.4 

19.9 

16.5 

19.5 

22.0 

R 


13.5 

13.6 

14.0 

11.7 

13.6 

11.2 

11.5 

13.7 

13.7 

14.8 

X 

- LOL* 

12.9 

12.0 

10.9 

15.9 

13.1 

16.9 

13.2 

8.8 

11.6 

13.4 


- UCL* 

28.5 

27.6 

27.1 

27.4 

28.8 

29.6 

26.4 

24.0 

27.4 

30.5 

R 

- UCL* 

26.6 

28.7 

29.7 

2^.7 

28.8 

23.7 

24.3 

27.8 

29.0 

31.2 

Individuals 












- L0L«* 

5.5 

2.3 

0.9 

5.6 

3.4 

8.9 

5.0 

-1.2 

1.8 

2.9 


- UCL* 

58.2 

37.5 

57.1 

35.7 

38.5 

37.8 

34.7 

34.1 

37.2 

41.0 


Table 8 

Occurrences Near or Beyond 3 -Sigma Control Chart Limits - Averages of 
5 Values Taken (1) Across Widths and (2) Along 
Lengths of Sheets - Expressed in Mils 


Coil 

No« 

1 

2 

? 

4 

5 

6 

7 

8 

9 

10 

11 

12 

15 

14 

15 

16 

17 

18 

19 

20 
21 


Across Sheet Width 


.Along Sheet Length 


Lrl, ii=2 

51.2 

10.6 


9.6 

8.4 

8.4 

30.0 

9.6 


- 1.0 


5.0 


JkdL 


29.0 

27.4 


29.0 
5.0 

11.0 


10.0 


6.0 




9.0 


10.6 16.6 


14.2 


15.6 




15.0 


8.4 

12.0 


1 = 1 . 

23.8 


4.2 


5.0 


T-4 

28.6 


4.6 


10.0 




3.C 


11, C 


11.8 

11.4 10.2 


22 

30.6 

29.4 

32.6 

33,0 

34.6 

32.8 

32.6 

28.0 

34.0 

32.8 

23 

13.0 

12,0 

10,0 

14.0 


13.0 

13.2 


10.6 


24 

32.4 

35.4 

32.8 

33.0 


34,6 

31.6 

29.0 

32.8 

33.4 

25 


31.6 

32.8 

31.4 

31.0 

32.4 

28,0 


28.4 



188 



Table 9 


Control Chart Statistics jror Orwps of Twenty -five Values 
Hepresenting (1) Entire Sheets and ( 2 ) Row-Column Sheet Fpsltlons - 
Expressed In Mils 


3 - Sigma Limits for 





Averages 

Std. 

Revs. 

ifndi vidua! s' 

Category 

X 

....ir ....... 

LCL 

UCL 

' " LCL 



Sheets 

20.2 

6.18 

16,4 

24.1 

3 . ‘*9 

8.8? 

1.1 39.4 

Row-Column Positions 

20.2 

8.17 

15.2 

25.3 

4.6a 

11.72 

-S.o 45.5 


(l.e.. LiAl) 




yabUJr^ 

Occurrences Near pr Beyond 3 - Sigma Control Chart Limits - Groups 
of 23 Values Representing (1) Entire Sheets and (2) Row-Column 
Sheet Positions 


Coll Standard Row -Column No« Standard,. 

Saj_ Average Deviation .Jl JL. Avgraga. 


1 

24,3 

5 

25.0 

7 

6.8 

11 

9.8 

14 

14.2 

20 

13.7 

22 

32.0 

23 

12.7 

24 

32.3 

25 

28.4 
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Continuing to examine the possibility of using control charts, let 
us note the limits listed in Table 9 ^or groups of 25 values as arranged 
to represent, first, entire sheets and, second, row/column positions 
(Lj^/Tj^). In each case we are dealing with 25 averages. Owing to the 
larger group size, sigma-bar instead of R-bar has, of course, been 
computed and used in determining the control limits. Again, in Table 10, 
as in Table 8, the occurrences beyond the control limits have been 
listed. It is evident that the over -all sheet averages are lacking in 
statistical uniformity. The fact that the row/column sheet positions 
show only 2 of their 25 averages beyond the control limits tends to 
support our previous conclusion from Table 5 that the individual sheet 
positions tend to provide similar results. It appears, therefore, as 
unlikely that the statistical control chart technique can be appropri- 
ately used in establishing ranges of expectation for Olsen ductility 
test values. 

Summarizing, we find, first, that Olsen ductility cup test values 
tend to be lower near the center of the width of sheets made from rimmed 
steel than near the edges of such sheets and that a source of this 
variability is the tendency of the molten steel in the ingot to 
chemically segregate toward its center. Second, the ductility values 
vary, but less markedly, along the length of the sheet. Third, that 
although diligent care is exercised in the selection and processing of 
steel sheets, their ductility values vary significantly on passing from 
coil-to-coil . Fourth, the averaging of ductility test values does not 
provide wholly uniform data on passing from the edge to the center of 
the sheet width. Fifth, the lack of statistical uniformity in the sense 
of Shewhart precludes the sound use of statistical control chart 
techniques in establishing ranges of expectation for Olsen ductility cup 
test values. 
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BESICSNING THE MEASGRElilT ^ OF WORK.. . 

John M. Allderige 
Eastman Kodak Conrpany 

A large part of Industrial En^ effort is devoted to "Work 

Measurement." This is put in q.uotes here since tlie activity as prac- 
ticed is more than just "measuring" the time associated with splice par- 
ticular work activity* In practice the engineer also selects appropriate 
characteristics of the operation to he time-meaetred, he iraprdv^s^^ 
and procedures where possible, and he sets tqp a control system for sched- 
\iling and, In the case of incentive stand^ds, pay whereby co\intable 
output can be related tp time input. In other words, "Work Measurement" 
really means a complete study and description of the operation. . 

This analytical process has two goals, both mentioned, abovi - 

Improvement of the operation - using less time, with less 

fatigue, more safety and generally more satisfaction. 
Control of the operation - knowing the labor content stich that 
future labor requirements can be predicted from estimates of 
future production requirements. 

The first goal - higher productivity and greater humanisation -;;is 
usually sou^t throu^ work simplification, methods engineering, econ- 
omic motivation of incentiye standards, and other types of motiyation. 

The second goal - control - is spu^t throu^ a quantitative description 
of the operation rolhting production and labor time. This cont^l is 
desirable since it usi^ly means better utilization of the individual^ 
operation with regards to the entire plant - that is, control usually 
results in hi^er overall improvement * !; 

Mathematics and sts-tistlcs are fundamental to •Uie effective reali- 
zation of these goals. In Statistical Quality Control, Experimental 
Design, and Operations Research, very powerful techniques have Jbeen 
developed that can be used in "Work Jfeas;i^^en^^^ JMs paper proposes to 

discuss some of tbetP mat^ and statistical teclaniques and their 

role in designing the raeasinremeirt and aniijrsis oFlro 
attention is paid to the second goal - seeking a control system - 
although some of these techniques can help in selecting better methods 
and better procedures .for improving the individuA operation. :The area 
of motivation. - ..such..as',incen^iyf^^^ st|^d§rd|',^-^^^_^^ 

this discussion. Mathematickl and statistical techniques have yet 
been developed - if, indeed, conceived - for characterizing the’ moti- 
vation of boman, behavior industrial production operations . 

In seeking a control system for an industrial operation, there are 
four factors of primary importance: (l) The decision tolerauci; (2) the 
decision period; (5) the mathematical model of the operation; (k) the 
measurement process. These four factors interact wit^ 
with outside factors in a fashion that can be best described by a small 
exaznple. Consider a simple repetitive operation of assembling ‘a bolt and 
nut. Now, the time to do 100 such assemblies would be arrived jat by 
multiplication: 

Average time per assembly x 100 ~ total time for 100 assemblies 
say, .2 minutes x 100 = 20 minutes 
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This is a trivial calculation, of course, but it can be expressed mathe- 
matically vith the following substitutions: 

S = average time = .2 minutes 
N = production of assemblies = 100 
T = total time 

T = = (.2) X (lOO) = 20 minutes 

where T = is the mathematical model for the operation. 

Now suppose the time to do an assembly, X, is subject to quite a 
bit of variation due to, say, ais carding defective bolts, as well as to 
chance operator variation in performing the assembly. If we wished to 
come to a decision as to the labor content for every 100 assemblies we 
nd^t run into trouble using X - the average time per assembly. Our 
estimates might vary from reality by more than some acceptable tolerance. 
We would continuously estimate 20 minutes when the actual times to do^, 
successive groups of 100 assemblies mi^t vary from, say, 15 to 25 min- 
utes. (This can be treated statistically, of co\xrse, but that will come 
later. The point here is to identify the problem in general terms.) The 
greater the variation in time per assembly, the greater the variation in 
the time for 100 assemblies. 

If we wanted to make an estimate that was not more than 1 minute off 
in each direction, we would then have to analyze the operation further to 
see what was causing the variation. One suggestion as to an assignable 
cause is the handling of defective bolts. That is, some assemblies 
req.uire picking up and discarding a defective bolt before making a good 
assembly. Svppose we decided to count such defective bolts in the future 
and associate a time with the handling of defective bolts. This is 
referred to as '’selecting another unit of measure” but, more fundamen- 
tally, it is changing, the mathematical model. Our calculation now for 
the time to do 100 assemblies is: 

Time for 100 assemblies = 

time for 1 good assembly x 100 assemblies + time for handling 
a defective bolt x number of defective bolts for the 100 good 
assemblies . 

If ^ = average time for 1 good assembly 

= nmber of completed assemblies = 100 in this case 

S3 

Xg = average time for handling a defective bolt 

N^ = number of defective bolts 
2 

T = total time 

Then the mathematical model becomes: 

T = ^ ^ N2 


192 



Whether or not successive T*s « estimates of time for the 100 assemblies 

- woTild more closely match actual T’s than before would be a raeastee of 
this model’s success. If it still was inadequate - if the resid\^ var- 
iation was still too hi^ - then more study would be required to develop 
a more extensive mathematical model. 

We have just demonstrated one inte^apting effect - that of the 
mathematical model on the decision tolerance. Given a decision tolerance 
and a decision period - in this case within 1 minute over 100 ass^blies 

- the engineer can seek a sufficiently descriptive mathematical for 

his control system by being aware of the variability in the syst^. !]Sis 
is essentially a statistical problm as will be reviewed 

however, that it may not have been possible to expand the mbdei. '' 
Supposing in making an assembly variability existed due only to chance 
operator causes such as Tfddely differing methods. "From the point of view 
of devising a control system, on the existing operation, these method 
differences are not countehlo would have to conjjlude 

that either the decision tolerance and/or the decision period needed 
modification . Sometiaing woi^ have to give. 

Widening the decision . tolerance, of course, is an obvious device - 
if the system can only give you a 2 minute tolerance aM you now decide 
to accept 2 minutes instead of 1 minute, then the problem is reaplved. 
Lengthening the decisipn period may not be so obvious to those u^amiliar 
with statistics but itjls reasona^^^ shifting from 100 

to 200 assemblies as ^th!|_ dfpisfe would reduce the effect of 

the Individual assembiy variation. That is, relative to some average 
time for 200 assemblies, the actual times for successive groups of 200 
assemblies vary less limn that same process with 100 assemblies.'; Put in 
even different words - the average times for groups of 200 assemblies 
bounce arotmd, less than, ^^t^ for ^oupis of 100 assemblies. 

The above demonstrates 't^e interactipn between tkie mthemat;ical 
model, the decision tolerance, and the decision period. The latter two 
are not always as inviolate as their ii^ althou^ they of ten 

exist as policy. In incentiye standards situations, for instance, it 
maybe policy ( tradition) to post earnings (percent effectiveness) daily 
and to require that there be no more then (say a % risk of no more than) 
pius-or-minus yf) variation for reasons beyond operator control (such as 
the occurrence pf defective bolts mentioned above) . Leng^ening this 
decision period to one week mi^t not be ijiqpbssibie if pay chechs^ 
issued weekly. Similarly in productipn programming arriving at |an appro- 
priate decision period depends on such factors as^ t^ the 

labor force, the degree of refinement required in meeting deadlines, and 
the degree of refinement required in cost estimating* It ish’t the 
purpose of this paper to explore the specificatipn of the decis|pn period 
and the decisipn tplerilica b^ out the relationship of -ttie oper- 

ation itself and these constraints. 

One other possibility in this triangle exists - changing the oper- 
ation itself . Work simplification, methods engineering, training^ and 
the improvement of product quality into the operation might all, be pos- 
sible ways of reducing methods differences. Of course, one traditional 
way is to use the time aiispciate^^^ particularly good method as a 

’’standard" and as a base for premixam production pay. This^^d 
approaches are only successfvil from a control point of view if they 
achieve reduced yariation and, therefore, better control. Incidentally, 
in such situations - wide^^ u^ variation - pay control, for 
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incerltive standards can "be brou^t within tolerance by a fixed allowance. 

So, we have described three of the four factors and some of the ways 
they interact. The decision tolerance and the decision period may 
require a mathematical model inopossible to obtain with the chance var- 
iation in the operation. Changing the decision period and/or the 
decision tolerance and/or the operation can bring things into a compat- 
ible state. The fourth factor, the measurement process, has to do with 
the engineer’s activities. In our bolt and nut exagple, fog instance, 
having decided to test the mathematical model ^ ~ ^1 % ^2 

would then be required to obtain, by time measturement, 

and Xg. Suppose Xg, the time to handle a defective bolt, varied 

greatly and therefore required an enormous number 
of observations for adequate precision. This data collection cost might 
well cause some second thou^ts regarding the use of this expanded model 
and/or suggest reappraisal of the decision period and/or the decision 
tolerance. So, the measurement process - either because of its sample 
size req'uirements or its difficulty in just getting a time measurement - 
can interact with these other factors. Thus we have completed the cir- 
cuit and probably best summarize this qualitative description of the 
designing of a work control system with a diagram; 


Decision 

> 

Decision 

Tolerance 

fer 

Period 




Mathematical 


Measuring 

Model 

^ 1 

Process 


To this point, the description has been purely qualitative. Let us 
now consider some statistical and mathematical techniques that can aid 
in the analytical process. We’ll start with the more familiar area of 
designing the measuring process and then move on to selecting the mathe- 
matical model. In this part of the discussion, the purpose is to 
indicate where some well-known procedures can be brou^xt to bear in some 
- not all - phases of Work Msasurement. These techniques will be 
described by name and by characteristic formulas easily recognizable to 
those familiar with statistics. References containing complete infor- 
mation on why these procedures work are noted and suggested for those 
unfamiliar with statistics who want to 3aaow what goes on ’’under the hoodV 

Designing the Measuring Process 

Measurement is the business of getting a number which reflects what 
is going on. The measuiring pjrocess has two problems facing it; 

XT) Accuracy - its representativeness; (2) Precision - its ability to 
reproduce measurement values . Accuracy depends on the typicalness of the 
sample that is selected. Random sampling guided by random number tables 
is an accepted manner of getting a random sample. This subject is well 
covered in statistical texts (l; and, with regard to Work Measurement in 
references (2), (5), and (4). 

Precision depends on saarple size. Here, specific statistical guides 
axe available and are covered in the indicated references. Some of these 
techniques in the Work Measxirement context are summarized below con- 
sidering first of all variables - or stop watch - work measurement. 
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stop Watch Work MgasTor^jent - Sjjaple Repetitive Cycle 


The approximate 95fo confidence interval forranla in v^iahl^s meas« 
2s R 

urement is 2s^ ^ Tlj ' siinplified by using in place of 


s, standardizing on sub groups of k, (n =5 k, so d^ = 2.059) and. using a 

2s« ^ 

percent precision value _ X The sin^lified formula: : 

: T 



where E 

1 

X 

N 


percent precision 
average range from groups of 4 
average cycle time 
sample size 


The engineer can specify E, use a preliminary study, of, say, iS^obser^ 
vations to get R and X, and solve for K. Or he can, knowing and R 
from a study, solve for E* A nomograph for this is displayed ip refer- 
ence (2). 

Stop Watch Work Measurement - Complex Cycle 


Not all repetitive operations are so simple, however. Consider one 
with this mathematical model: 

Average total time per piece = 

. average tray handling tiJTie 

Average time per piece + — .r . 

XI. c average pieces per tray 


% “ + f 

■'b 

As before, the interest is in the percent precision E 


where X^, X3 and Pg are all v'arying 

2s« 

100 . 




A simplified foraula for obtaining E has been developed (2) considering 


that 


+ s» and using the customary expression fof ;fche 

V V 




B 

variance of a quotient (5) so that the second term becomes 

P + 4 w 

F A 


f B 


The simplified formula is E 


■'B 


- 27 


with E and 


as defined above and observations on the main cycle tim^a ^ 

R* = R^ (1 + .15u) where R_^ = average range from groups of h X^^s and 

u = the number of auxiliary elements such as B in this case (u = 1 of 
course, in this case). Ag. with the simple cycle, the engineer |can 
specify a desired E, get Xgi and R* from a short preliminary study, and 

solve for N^. Or, having N^, Xj, and R* from a study, solve for E. The 
nomograph of reference (2) also works here. 
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Work SeagpHng (attri^butes measurement) - Simple Case of jo Busy 

The approximate 951^ confidence interval formula in attributes meas- 
urement is 2 4? (l-P) • yoTh sampling, P becomes the percent 

2g_ _ L 

busy, 2s^ the precision es^ressed as an absolute percent plus-or-min\is 

interval, aM N the number of b\isy - not busy observations . The engineer 
can obtain P from a short preliminary study - say 80^, specify 2s^ - say 

or from to and solve for N \diich would be 400 in this case. 
Or, having P and N from a study, he can solve for 2s^. The nomograph of 

reference (3) handles this calculation. 


Work Sampling (attributes measurement) - Con^lex Case 


Quite often the engineer is interested in breaking down percent busy 
into 2 or more classifications. The mathematical model becomes 
P^ = Pj + Pg + . . . etc. with the P values varying. A simplified for- 


mula has been developed based on reference (6) solving for 


?|2 


E = 


200 


(i-p, ) 




(Pl + Pg) n/h 


- 2P^ P* 
1 2 


In a multi -element study with many P values Pj_ » the P value with the 
hipest relative upward shift (maximum ^i ) and Po ~ P+ - Pn • A P* 

y^ue is an estimate of the maximum probable P^value. So, given current 
P values from a preliminary study, estimating P* values from the study 
or history, and specifying E - the desired precision on some future pos- 
sible mix of proportions j the engineer can solve for N - the sample size 
to take now . Or, given N, P values, and P* values, he can solve for E. 


Selecting the Mathematical Mpdel 


Internal Variation ; Recalling the earlier example with the model T = NX, 
the engineer must be satisfied tJaat this ’’one unit of measxire” model is 
all ri^t. A first check can treat the average decision period produc- 
tion as a sample and see if the 957^ confidence interval on that sample 
is within some specified tolerance. He essentially solves for a value 
we *11 call 2s» where 23^ ^nd Np = decision period 

Er=-^ 100 2sg=^ 

production. If E^. > say, then one unit of measure is insufficient. 
The expanded model ^ ^ 1^2 coiild then be tested and so forth. 

The simplified formula for this using groups of ii-, R, and d 2 is 

E ss — and it can be handled on the nomograph of reference (2). 

Between Decision Period Variaticn : Besides short term sampling variation 
in the operation, there may be inherent decision-period-to-decision- 
period variation. Determining whether or not this variation (call it 
2 s^ 3 ^ ) is greater than some specified tolerance (say 57^) can be a tricky 
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problem. One vey is to observe seversO, decision periods cpnapletely and 
get a sample between-decision-period standard deviation. n!his c|n be 
eaqpensive, however, and using the notion of variance cooQ^onents would 
appear much better from sevoral decision periods 

(at least 2) the following relationships would pervail: 

Total variance = sampling variance + decision period vari^ce 

sf = s^ + and s? * 

T s d d T s 

Total variance, s|, is observeds sampling variance, s|, can be calculated 
by pooling decision period variances; and one can compute s^ - the 

variance associated wii^^^ period variation that would prevail 

if there was no sampling. Components of variance ^^e covert 
extensively in reference (l). 

!Hae interest in tMs case is in 2 .qq. Getting s| and then 

from a preliminary study along with ^ the engineer can match the com- 
puted against the tolerance. If it*s greater, then more units of 

measure are needed and model can be tested. There a pos- 

sibility, of course, that sample size Is ins\tf^icient for any decision - 
s' > s£ - and further study with a larger saai^Jle is then required. 

Ifeiltiple Regression - Variables ; We have tallied tp tot^^^^ 
pro^essively expanded models until the residual variation is within 
tolerance. Bbe tanit asstmption has been that times for each nfwly con- 

sidered auxiliary element of the bp^atioh were obtainable by direct 
observation . This is not always possible such as in the case o^ 
packaging operations. The time to package one type of item an^i^ 
types being packaged Is often thoroughly mixed in with and depend 
the times of packaging these other types. All that is known about thp 
(deration is that for each package some total time has been put into 
packaging and a variety of countable types of items packaged. The 
question is: Bpw^^i^ of the item types shoiild be epunted f^ 
adeq.uate control system? The question, of course, only comes af^er 
having decided by previous tests that just counting packages is insuf- 
ficient. 


This is a problem in nmltiple linear re Consider!; 1M 

typical example wherein from a short prellraliiaiy st-udy times tot 
packaging one oid-er (Xj) have been obtained along with the associated 

counts of the three types of items being packaged (N^^, Ng, K^). 

Time to Package Number of Items Ihmaiber of Items Number pf Items 


One Order 


of Type 1 


of Type 2 


of l^e 3 

N, 
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The resialts of a inultiple regression analysis (see reference (7)) on the 
cQH^lete data from studying l6 orders showed the following: 



^ ^ \ “1 

+ Ng + Xj 



Decision Period (Daily) 

i_ 

A. 

Variation (Ej.) 


•5iH 

6.0^ 

0 

.518 

. 

1 

.852 

5-9 

2 

.813 

1.2 

5 

.013 

.9 


= .318 + .852 

+ .815 Kg + .013 Nj 


Note the recording of the residual variation (Sy^) opposite the asso- 
ciated regression^ coefficient (X^^). This is phrased in terms of chance 
variability of a decision period (daily) sanrple N-d: „ _ ^ ^Xi 


If were satisfactory for then item type 5 could be dropped. Sub- 
jecting the final study to a two type regression analysis woiald probably 
generate a model satisfactory for the control system. Incidentally, 
sample size can be approximated in such cases by using the previous con- 
fidence interval formula 2 Sv^ where is the cut-off value 

E ^ li 

(Sy^ in this case). Also note that E^ - between decision period 

variation - can be examined by analyzing the individual regression 
residTial values. 


Multiple Regression - Work Sampling : The same approach can be used with 
work sampling results from a non-repetitive operation study. A work 
sampling percent busy can be easily converted to a time estimate. Con- 
sider these data from a study of the electrical trades; 


Job No. 

1 

2 


Total Job Time 

Percent Busy ( from job tickets ) 

73 X 32 hours 

65 X 171 " 

I t 

I 


Direct Labor 
Time 


38 hours 
111 ” 


The time inputs for each job studied and the associated counts for each 
job of the conduit sections, footage of small size conduit installed, 
and footage of large size conduit installed - these were the ingredients 
for the multiple regression analysis; 
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No. 

Work 

Sampling 

Hours 

% 

Conduit 

Sections 

% 

Small Size 
Conduit 
Feet 



large Size 
Conduit 
Feet 

1 

7.5 

17 

13 

72 

2 

76.7 

180 

804 

2hl ■ 

5 

9.0 

29 

0 

62 ; 

k 

f 

26.7 

t 

73 

1 

599 

1 

"O' 


f t f » f 

=*= .25 + .12 % + .Oil. Ng + ,08 Kj 
2 Sy^ = O hours or on the average job 

Fewer or additional units of measure could have jbeen 
residual variation was felt to be correct. 

Queueing Models ; Service type labor is often analyzed in Work Measurer 

ment . ^ lEhis' 'is labor on. a. ^ demand,, basis - ,..l^or,,,ctf 

non- repetitive type whose services are constantly on ca3d but oiiiy inter- 
mittently, randomly used. Machine-breakdown repairmen are in this cate- 
gory and are Increasingly important as automation moves into the,; picture. 
Oddly enou^, this control problem has become more prominent as the iise 
of work sampling has Increased. For work sampling has effectively dis- 
closed, time and again, the fact that a service crew is inactiye;| part of 
the time. But this information is not eno Arbitrary crew reduction 
merely creates machine delays on those occasions when several mafihines 
demand seirTlce at once, possibly as costly as idle labor. 

The idle labor can be cpnsider§d as 1^ "queueing i:p” or iiaiting 
in line to service machines. Machine delays can also be considered as 
machines "queueing tip" to be seirvdLced. This queueing problem can be 
resolved by the use of queueing theory - a segment of probability theory 
- which permits the engineer to predict the effect of various cr^ sizes 
on the idle labor and nmtchlne w^ 

Here is a simple example. At our Kodak Park Works, the Kodacolor 
Printing Room, at a particular production level, had a crew of 3 handlers 
per shift supplying and inspecting n^a^ines of photographic paper for 
28 printers. Since thesb niagazines^ h paper of vai^ng length nod the 
printers had varying speeds, the demand pattern for stqpplying ma.j^zines 
was quite unsystematic. Nobody knew Just when a printer, or, indeed, 
several might be in need of a magazine change . The inspection of maga- 
zines was routine, however; they could be inspected at leisure and 
stored until needed. So the problem was one of controlling non-repetitive 
labor, a portion of whose services were randomly demanded. 

Work san5>ling results showed the three men were busy of the 
time (l). 

The obvious mpye to reduce the about 

activity x 5/2) was not automatically the ri^t move owdhg to 
the demand nature of their wfkr Queueing -ttieoay had to be employed to 
evaluate the effect of sdch a possible move. 
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The engineer procured the following basic information about the 
operation; 

1* m * 28 = number of printers under consideration 
2* r = 2 = number of servicemen under consideration 
5* a = ^ » .021^ 
u 

V^here * 3*1 minutes ® the average time for a handler to s\:^ply a 
magazine to a printer. 


u = 125*8 minutes the average run time of a printer 


The average magazine change time ) was obtained from regular stop 
watch studies. The average printer run time (u) was obtained from 
printer logs where the paper footage for each run was recorded. Knowing 
printer speed, time for each run and the average run time were simple to 
compute. With this basic information, the engineer used a table based 
on this mathematical model (see reference 8): 


m l a”^ 
nJ (m-n)! 


rl r^-** (m-n)l 


r ^ n ^ o 
r ^ n 


\^oJ 


E (n-r) Pjj 
n-r+1 


n 


Pn - 


1 


Z (r-n) Pn 
n=0 


" p 

n=o ® 


where ® the p3X)bability of n machines being down together (requiring 
service) 

(Pq » Pji for n « 0) 

i = the average machine wait time expressed as a decimal fraction 
f » the average serviceman wait time expressed as a decimal fl'action 


He determined the values as follows; 


i « .0033 or about .3?f 

the average fraction wait time per printer 

f = .6353 or about 63. 5?^ 

the average fraction wait time per handler 

Thus he could say that if the crew were reduced to 2 men, the delay 
introduced by such a reduction (delay due to interference) would be about 
• The handler idle time, of course, would be much less than 63. 55^ in 
actuality owing to the inspection portion of the job; the work sampling 
2-men crew estimate of 71^ busy, or 29^6 idle, would still hold. Queueing 
theory only considered the random demand portion of the operation. A 
final check on the aplicability of the model had to be made. The com- 
puted i and f values for the observed (3 man crew) situation were com- 
pared to the actual sampling results on i‘and f ; 
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i 

f 


Observed 

0 

7% ± 5i> 





Otese observe data fitted the modei for all practical purposes meaiaing 
the 2 naa crew predlctton was quite likely valid. 

Ihere are other i^chine interference models (reference 9) ladling 
other types of situations . Uote that here we can achieve inprovement , 
perhaps, in the operation as well as gain control, iroduction |evel 
shifts (more machines) can be considered in this xnpdel wd, for, a desired 
i and f balance, the optimum crew size assigned. Ihe **unit of measure” 
here is essentially the nuxaber of machines and crew size is the .'dependent 
variable. Ihe j^ction is not a simple linear one but can be t|bulated 
for scheduling use. Msmy "indirect” type operations are susceptible to 
this type of control idiere the unit of control is an Indlvidual^^ - not 
some portion of his or her time as in single repetitive cycle. ' 

liney Programing and Handling ; Considerable attention has been paid to 
the "indirect" opgratibn of to Work sampling has made it possible 

to measure thijS activity but activity measures do not always resolve the 
problems of either control or improvem^ The linear prograimBing mo^ 
is effective in specifying the optimum d^loyment of handlers tp meet 
specified service requiremehts . Consider this handling problem‘s with the 
fpllowing demand matrix of loads per hour; 


From 

Area — > 12 3 

1 0 12 4 

To 2 6 0 2 

3 5 10 


These areas are equidista^ If a handler can move 6 loads per; hour then 
the ideal number of tendlers in^s^ is 64r5-i-l^l2-i^4-t‘ 2 ,30 _ 


To set a good method of handling (not necessarily the ^*one best 
method” but a good one) by linear programming to achieve one h^ service 
some possible routes can bp listpd ** 10 to start with. And asso*> 

dated with each route is an unknown number of handlers; 


Bpute 


Number of Handlers 


I 1, 2, 1, 2, 1, 2, 1 a 

II 1, 3^ 2 , 1, 2, 3, 1 b 

HI 1, 3, 1 , 3, 1, 5, 1 c 

etc. 

Now, for each elaaent in the demand m can be written. 

For instance, eluent 1, 2 req.uires 6 Irr^s per hour be moved. Route I 
can move 3 loads for each hanfUer on t^ and Route II can move one 

load for each handler it has. So, 3a 4 b ^ 6 if these 3 routes are the 
oxiiy ones considered. Other routes among the initial 10 mi^t have a 
1,2 segment so the general inequalities for this a^ elem^ts become; 
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Element 


1,2 

1.5 

5,1 


3a + b + . 

b + 3c 
b + 3c 





6 

5 

4 


and ve would want to minimize the total number of handlers sa + b + 
c + • . . lEhese inequalities along with the function to be minimized 
constitute a linear programming problem# Solution techniques^ some 
underlying ideas in linear programming and a repoirt on a somewhat 
similar application with railway frei^t cars are contained in the refer- 
ences under (lO). 

A few comments on this type of application - the solution to the 
above may not be the best since all possible routes have not been con- 
sidered# However, it*s very easy to write down any number of additional 
routes and assess their improvement, if any. Also - high variation in 
demand may T:q>set service. Each channel with a given schedule can be 
examined with quexieing theory and the channel especially loaded if the 
waiting line is too long. Note that here, again, both improvement and 
control are achieved. As demand increases or chfinges the d^loyment of 
handlers must change, ^e relationships can be pre- computed and tab- 
ulated - the siiaple linear relationship of production x average time no 
longer holds . 


There are four basic factors affecting the design of a work control 
system: The decision tolerance - how close you want to be in predicting 
or stating labor content; the decision period - how frequently you want 
to make a prediction or statement; the mathematical model - symbolic 
portrayal of the elements in the operation; and the measuring process - 
what the engineer has to do to get the numbers for the mathematical 
model, 3hese factors all interact and the industrial engineer seeks a 
balance among them every time he undertakes a Work Measurement study. 
This balancing is usTially intuitive and usually ers^ensive in that poor 
decisions require later analysis to r^air the situation. Statistical 
and mathematical techniques do exist to help the industrial engineer 
handle these problems with considerably greater effectiveness. As 
demonstrated in Quality Control and in Cperatlons Research, the payoffs 
can be huge on both cost cutting for the plant’s operations and reduced 
engineering time. 

A vast gap exists, however, between the knowledge available and the 
knowledge used. Quality Control people are ideally situated in industry 
to bring these ideas to others * attention and to demonstrate, by their 
own efforts in their own field, that there is a vast potential. In 
proportion as we all team tp and tap the immense theoretical power that 
is just out of reach now, we can move toward our mutual goal of bringing 
more science to management. 
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QUALItr COKTIiOL APPLPD TO . 

Charles R« Hicks 
Purdue Uniyersity 

As I have been assigned one-quarter time in the department of ^ 
dustrial J^lAeerizikg d\iring this present year at P^due, I hope to be 
able to give some up-to-date examples of the application of sta^sticaJ, 
methods to M problems* X mould prefer to general- 

ise the topic somewhat to Include many statistical methods and Just 
those which I usually aasbciate with quality control* I prefer to think 
of quality control as somewhat restricted to those techniques directly 
aimed at pqntrpl of thf^ of the product such as control oharts^ 

acceptance sampling plans and the like* I realise that many q^p-ity 
control people often consider quality control as covering any aiid all 
statietical techpc^^ applied to induelllsl P^^oblems* Our topp might 
be stated then as ” Statistical Methods Applied to Industrial E^lneering^* 

Of all ths, to probably the industrial engineer 

has been most receptive to the uee of statistical techniques alihou^ 
other branches of engineering are gradually beglntning to appreciate the 
value of statistical end probabilistic thinking* Evidence of this is 
found in the fact ttot nearly all accredited Industrial Engineering cur- 
ricula in our uniyersitifs now require at least one^ and ustxslly two^ 
courses in statistics and quality control for their undergraduate engi- 
neers* ■ . ^ 

Now why is the industrial engineer so concerned with statistics'^ 
let us lock a definitipn of Industrie! Engineering adopted recent^ 
(1956) by the American Institute" of l^ustrdal Engineers (A*I*I*E*)t 

”Industriel is concerned with the design^ impruyemeht^ 

and installation of Integrated systems of men^ materials and equipment* 

It draws upon specialized knowledge and skill in the mathematiqal^ physi- 
cal^ and social sciences together with principlee and meth^s qf engi- 
neering analysis and design to specify^ predict and evaluate the residts 
to be <^tained fyqm such aystsms^ 

Frcmi this definition^ we can see that 3[ndu8tri|d is 

concerned with the design of systems involving men^ materials equip- 
ment and with analysis and evaltmitioh of result’s obtained from^these 
aystsms* Sorely statist ii^ techniques are necessary here in aeilii^ii^ 
experiments and in analysis of the results* The A«I#X«E* was Started jln 
19AB and Is thus a contemporary to A*S*Q*C* It now has 53 chapters and 
some 4D00 senior and associate lembers^^^ j^^ of its activities and 
interests pysrlap those of our society* la the last few years with the 
advent of this undef inable monster caUsd **0peration8 Essearch!! the 
seiencs of Industrial Engineerii^ has "one of its ^?eatest bppoHimitles 
to grow and develop more professional status than it hss had iiiiL many 
years* HSny of the teohniquee of bperatione reeearch are Wtiu^p' for 
the induetxdM engineer tot do jre^^ a stronger background tton he has 
been used to in mathsmaties^ statistics and probability theory* One of 
the writers in the area of Into^tri^^ stated that Hwp needm 

conf ront education if we are to make the ttomsif- 

ticm to professioniJL practice* These are: 

1* The introduc^^^ powerful quantitative^ mathetotical, 

statistical metiods to provide more precise tools fto; planning 
and evaluation* 
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2* The introduction of and thorough gro\mding in the behavioral 
and social sciences to prepare industrial engineers for the in- 
tegrated systems design job they must carry out*” 

Now as to specific applications of statistical tools in Industrial 
Engineering, I believe a paper by Professor Howard P* Ehierson of the 
University of Tennessee, and present President of A*I*I*E* entitled ”A 
Mathematics Foundation for Industrial Engineering” is the best single 
source of information on such applications* Professor Enerson spells out 
in two columns the statistical techniques and the corresponding Indus- 
trial Engineering application. Some such applications are Quality Con- 
trol, which we are all quite familiar with as it applies to control of 
process variables; Motion and Time Study, which is often given the more 
sophisticated name of Work Measurement, Merit Rating, Plant Layout and 
Design, Estimating and the Precision of the Estimate, Methods Improve- 
ment, Evaluation of sources of variation. Operations Research, etc* To 
discuss all of these and many other applications of statistical methods 
to Industrial Engineering would far exceed our time limitation, so I 
should like to discuss in some detail three problems from the areas of 
Work Measurement, Experimental Design and Replacement Theory the latter 
being often construed as belonging in the Operations Research area* 

I* WORK MEASUREMENT - The problem to be presented is taken in 
somewhat simplified form from a paper by John AHderige in a recent 
Issue of the Journal of Industrial Engineering* (2) 

The problem was to determine how large a sample (n) should be taken 
for a time study to detexmine the average length of time for a given 
cycle, how to be assured that the results obtained are consistent, and 
what precision can be expected in the result or how close may the re- 
sult be to the true average time. This problem has been attacked by 
many people in Industrial Engineering but Allderige makes use of many of 
the ideas we use in control chart analysis which should make his approach 
of interest to the quality control man* 

The method proposed is to take a preliminary sample of k groups of 
4 readings each of the time to complete the given cycle, these 4 groups 
of readings being taken at random times throughout the day* Using the 4 
groups, 4 averages and 4 ranges are computed and from these the grand 
average ( 7 ) was found (for the problem he gives, equal to 1*00 minutes) 
and the average range (R) ■ 0*40 minutes* With this information and 
statement as to the precision desired in the final average time of the 
cycle (say, to be within 5^ of the true average time), he determines the 
number of additional cycles to be timed* This additional sample size is 
given by means of a nomograph in the paper but can be worked out for the 
data given as follows: 

Assuming a normal distribution of time study data the statistic: 


1 - 1 ' 

* o* is normally distributed 

with mean of zero and standard deviatj^on of one* Here X' Is the true 
average time we wish to estio^te and X is the observed average time* 

We want X to be within 5'^of X' or X - X' » •05X'* As X' is unknown we 
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uee T as 1«he best estimate of 3C' based pn th^^o^^ the 

time standard deviation of the process and can be estimated by R/d2 as 
is done in quality control chart analysis* Z is usually set at i«96 or 
2 representijig two standard deviations on a noxmial distribution yhich 
Ttfill give approximately 95% confidence that our n will be sufficient to 
estimate the time mean vrith 5% precis^ If the expression above is 
then solved for n, we have the total number of cycles that should be 
timed* Or, for our data: 

5 ■ 1*00 min* a* » R/d2 

R ■ 0*40 min* ■ *40 min* 

X - X' - *0^ 2*059 . 

Z ■ 2 as d2 ■ 2*059 for samples of 4 

Hence substituting: 


2 


Ln05.}il,0Ql 

*40 

2*059 vHT 


Solving this for n, we get n « 61* As we have already taken 16 pbserva- 
tlons, this means to take 45 more* To check bn the consistehcy bf the 
results, an X chart is suggested; which, if in control for the l5 or 16 
points (if we continue to take groups of k)$ means that the average time 
is consistent from hour to hour Ifhroughout the period of the chaH* 

Thus a check can be made on consistency and the precision required can 
be Set in advance* jCf, for ^xanple, we had wanted Imprecision, we 
would have used X • X' • .OIX and the resulting n would have beeh 1509 
observations or 1493 more than the preliminary sample! 

This particular approach is qiU.te simple compared to some others 
that are used as it USSS ranges rather than standard deviations*’! The 
only serious question about this approach is the assumption of normality 
of time study data which is being studied at Georgia Tech* and furdue 
at the present time* There is a strong Indication that time etii^ data 
may be positively skewed* 

II. EXPERIMENTAL DESIGN ^ Designing an experiment to study the 
effects of men, materials and equipment is very Importent to the! indus- 
trial engineer* In the problm to be discussed, one of our grab^te 
students at Purdue wished effect of the degree of SjOTnetry 

of an object on the time required to position and assemble two^^^j^ 
parts* Previous studies suggested that objects could be classified as 
perfectly symmetrical (circular)* non-symmetrical (fitting only one way) 
and semi-symmetrical (all others)* An esqieriment was designed tp deter- 
mine whether an increase In the jiegre of symmetry from non^syim^trical 
(or 1 degree of symmetry) up through 6 degrees on s^^etry would tend 
to decrease the time required to position and as^^ matir^ parts* 

The experimenter Chose to study profiles having one, two (rectangle), 
three (equilateral triangle), four (square) and six (hexagon) degrees of 
symmetry and see how the average time to position and assemble mating 
parts with these profiles would change* In planning the experiment it 
was readily recognized that there were several other variables 
would effect the average time to position and assemble a part, the most 
obvious one being the operator who perfoxmed the task* It was decided 
to select 14 operators at random from ^aduate industrial engin^rlng 
students at Fu^ue and try several runs using each of the 5 different 
profiles* The profile presented to a given operator first, seebnd. 
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thirds etc* was decided by a random presentation in order to help reduce 
the effect of learning and fatigue* As weight of the object might be an 
important variable affecting the tlme^ all profiles were hollowed out 
such that all had approximately the same weight* It was also agreed to 
have each operator try several runs using each of the 5 profiles and 
then only the middle 10 readings were used in the analysis* These and 
other considerations led to the formulation of a mathematical model to 
describe the experiment* One of the more modern trends in the operations 
research area is to try and formulate a problem as a mathematical model* 
Our model here is given by: 

Yijk - At + ♦ Oj + (PO)ij + 6k(iJ) 

idiere: is the observed time for the run of operator J using 

profile i* 

ti is the common mean in all data* 

Pi is the profile effect where i*l, 2, 3, U 9 5 for the 5 profiles* 

Oj is the operator effect where J ■ 1, 2, * * * 14 for the 14 operators# 

{P0)ij is a term representing a possible interaction between profiles 
and operators* 

6k{ij) is the random error as seen in the k runs for each operator, pro- 
file combination* Here k « 1, 2, * * • 10 runs. 

Such a model implies a factorial design with 5 x 14 x 10 ■ 700 
observations and the results to be analysed by the analysis of variance 
technique* Another feature of this design is that it is a mixed model 
in that the profiles are fixed and the operators are random* 

As the analysis of 700 observations seemed quite laborious, several 
short cut statistical techniques were used which should be of interest 
to quality control people* For each of the 70 cells (5 profiles by 14 
operators) the average and range of the 10 observed times were computed* 
The ranges were then plotted on a range ehaz*t and this was examined for 
homogeniety of variance within the 70 cells* The more exact test would 
be a Bartlett test which would be much more work* Also from the average 
of these 70 ranges which were in good control an estimate was made of 
the standard deviation of the errors using R/d2 with d2 based on samples 
of 10* Then the analysis of variance was znm using only the averages 
in each cell as the variable. This, of course, gave no exact test for 
interaction but this could be checked from the estimate of error made 
by using R/d2* Whether the interaction is significant or not will not 
affect the test on profiles as this is a mixed model* It was decided 
to test at the 17<>level of significance and the following table was 
compiled from the data: 
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ANALYSIS OF ON 


TABLE 1 


Source of Variation 

d.f. 

Sum of Squares 

Mean Squares 

, Expected 
MeSri'Sqoare 

Profiles 

4 

6,224.51 

1,556.13 

oi^+oi^4l4oj^ 

Due to linear r eg* 
Departure from lin* 

1 

4,350.19 

4,350.19 


reg. 

3 

1,874.32 

624.77 

oi+ 5^ 

0 "O 

Operators 

13 

18,124.00 

1,394.15 

0 X P and error 

52 

12,229.74 

235.19 

°e 

total 

69 

36,578.25 




Looking only at the profile , operators^ and P x 0 and errpf liney 
the expected aean square column shows that th^^ test for jirofile 

effect on the average time is to compare the profile mean square with 
the 0 X P and error line mean Thus the F ratio here is^; 

F(4,52 d.f.) 6.62 

idiich shows a significant profile effect at the l%level of sigMYicance« 
This gave pretty good evidence that the degree of sjmmetry as revealed 
by these 5 profiles has effect on the average' time iaecessary 
to position and assm^ble mat^ parts* ! 

As this test indicated that the degree of symmetry did affect the 
time, it was then wondered what the relationship might be* Plowing 
the average times for each degree of sj^yetry led to ihe^^^l^ 
there might be a linear relationship between degrees of symmetiy and 
time with time decreasing as the degree of s^nmetry increases* ; From the 
data the sip of sqiiareb due to linear regression was also computed and 
is given in the table above* The difference bft^en t^ 
squares among profiles is due to the departure from linear regression 
and this departure was tested by comparing the mean square of 
with the 235.19 or: ;; 

P(3,52 d.f.) - - 2.66. 

235.19 

This is not a significant departure from linear regression at the 
l'%signlficance level so that a linear reliatioixship might be reasonably 
assumed and th^ equation of such a line could be written* We 41^ so check- 
ed the value of eta squared « 0*34 and r^ ■ .24 which indicates that 
about 24^^ of the variwce in average times mi^t be accounted for by the 
straight line and 34%»mi^t be accounted for by a line throu^ all 5 
average points* (For the benefit of the astute statistician, Mh sub- 
tracted the operator sum of squares from the total before calculating 
these statistics)* 

More research is in progress oh this problem but this example is 
presented to give some Indication of the kinds. of statistical ^nd qual- 
ity control techniques that are useful to an industrial engineer." 

Ill* REPLACEMENT T® problem reported by some wprtcers at 

Case Institute of TechnoXogy has to do with idien to replace items in the 
plant* Is it best to replace a machine, say, when it breaks di^ or is 
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it better to replace several machines at regular intervals regardless of 
their condition? If the latter is best^ what is the proper replacement 
period in order to make the overall cost a minimum? 

The problem cited is a s<»iiewhat simpler problem on the replacement 
of a system of 10 light bulbs* It is assumed that it costs ^^1*00 to 
replace a bulb when it fails and this must always be^ done* It costs 
only 50 cents per bulb when replacing all 10 bulbs at one time* The 
problem then is to decide on a proper replacement period; say 10 days, 

20 days, 30 days or 40 days to replace all 10 in order to give a minimum 
anntial cost realizing, of course, that any single bulb will have to be 
replaced whenever it fails* 

A mathematical model giving the total cost is expressed as follows: 

C - X [N * P(tr) Cl + N • Cg] 

where cost of replacing an individual bulb « ^ 1*00 

C2 cost of replacing an individual bulb if replaced as 
one of a group of 10 • 0*50 
N number of units in the system « 10 
tj» time between group replacements » 10, 20, 30, 40 days 

C total cost of this replacement policy over time T* 

probability that a bulb will fail before time ty* 

Every variable in this equation is known except the probability 
that a bulb will fail before time ty* In order to estimate this proba- 
bility for time periods (ty's) of 10, 20, 30 and 40 days, a Monte Carlo 
technique is suggested* This simply means that we play a game with seme 
*typiced^ data to empirically estimate the value of this probability for 
each time period ty* This can be done without any expensive experiments- 
tion if we have some past data on light bulb failure* 


Assuming that bulb life is approximately normally distributed with 
a mean bulb life of 30 days and a standard deviation of 10 days, a table 
of normally distributed randooi numbers can be used to assign a random 
life to each bulb* If, for example, the normal random number drawn is 
0*5, this means that the bulb would be assigned a life 0*5 standard 
deviations above the mean or 35 days* Such a bulb would survive a 10, 
20, or 30 day replacement but a new bulb would have to be put in before 
the 40 day period* In this latter ease, a new randemt number would be 
drawn to see if the new bulb would survive the remaining 5 days imtil 
the 40 day replacement* Sometimes several bulbs may have to be used 
in a given socket before the 40 day period occurs* 


Such a 'game' was played for the 10 bulb sockets with some of the 
results shown below: 

BULB FAILURES FOR A GROUP OF 10 BULBS 


. Bulb 
Socket 


TABLE 2 


3^0 Total 

Failures 


10 

days 

35 

31 

55 

27 

20 

n 

35 

31 

55 

27 

30 

If 

35 

31 

55 

27,55 

W) 

i» 

35,66 

31,36,62 

55 

27,55 
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The numbe^^s entered^^ i^^ of the table are the number jjf days 

life for each bulb chosen at random* For socket 1, for example, the 
f irst i^b 35 days life would survive the 10, 20, and 30 day re- 

placement but not the 40 ^7 replacement* Hence, another bulb waj^ in- 
serted (drawn fzN)m ptq:* normal r^ its life was 31 days 

which vrtien added to the 35 gave the 66 days shown in the table which 
means that the 2 bulbs would last^^^^j^^ day replacement* in the 

case of the second socket, however, the second biilb chosen had a ]Life of 
only 5 days making 36 in all which means still another replacement before 
the 40 days replacement period* Adding the number of replacemente for 
each period for the IQ sockets gave the values shown at the right of the 
table* One trial of the ”game‘* is hardly enough to estimate the jproba- 
biiity of failure before t the game was repeated 10 timeis giving 

the following number of failures for each trial ;j 

BULB failures IN 10 10 B^ 

TABLE 3 



If the total failures in IQ trials of 10 bulbs per t rial is , now 
divided by 100, the last column gives a pretty good approximati6|i to the 
probability of failure of a eingle bulb for time t * If these pi^ba- 
bilities along with the corresponding t values are now substitu|ed in 
the cost equation, we find: 


C [N P(tp C, + NCg] 

Pqr 10 day replacement; C ■ [10(.01)(1,00) + 10(.50)] = ^183.60 

20 day replacement: C » ^ [10(.15)(1.00) + 10(.50)] - ^liy.OO 

30 day replacement: C = ^ C10{.51)(1.00) + 10(.50)] = ^14.20 

40 day replacement : C •• ^ [10 (.96) (1.00) + 10(.50)] - 431.40 

A glance at these anniial cost figures reveals that a 20 day replace- 
ment period would give the least cost to the company* It is interesting 
to note that this reside playdJig a game with some; numbers 

drawn at random from a table of normally distributed random nuinbers and no 
expensive experimentation was necessary. Some mathematician might wonder 
why we didn^t simply differentiate the cost equation and find the value 
of t which gives a oinimcum cost* Because of the probability function in- 
volvid, this procedure would require taking the limits of an inf|inite pix>- 
duct of normal integrals which is quite prohibitive from a practical point 
of view* The results above might be improved still fuirther by t lying re- 
placement periods arouni 20 days such as IB, 19 and 2l, 22 etc* -and use a 
Monte Carlo scheme of game playing to narrow the results down tq the best 
number of days for the 10 bulb replacement. This very practical problem 
for an industrial engineer has been included to show how a ^^^^s appli- 
cation of normal random numbers usqd to help solve the pi^blem* 
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Many other examples might be mentioned illustrating the vital role 
of statistics in Industrial Engineering but these three should give some 
indication of the kinds of applications that have been made. At the 
present time, Purdue industrial engineers are viorking on such problems 
as a mathematical approach to plant layout seeking the optimal layout, a 
statistical analysis of the factors affecting plastic tools, checking 
the normality assumption of time study data, work on a statistical deter- 
mination of economic lot size etc. 

Most any industrial engineer who is well informed in his field will 
readily agree that statistical methods provide one of the best tools for 
solving his problems. 
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WHAT IS AN INSPECTOR 


Daniel G* Meckley, III 
York Division of Borg-Warner Corporation 


To ta]Jk about the modern concept of an inspector, we must examine 
the historic and prehistorip begins of the breed. The development 
of the inspector has many elements of evolution and many elements of 
a modern day revolution. Inspectors are not newj the Bible recbrd^ 
instances of overseers and inspectors in terms of rather evil execu-* 
tions of kings* wishes# ii 

Our first concept of inspection was the detection of defective 
work, largely based on the premise that the operators were trying to 
slip something over on the company# This quickly led to the operators 
banding together in an attempt to frustrate the inspector and shpw 
that they were smarter by slipping in sub-standard work which he could 
hot detect# Subtly, the operators * entire attitude changed, arid in 
many cases they lost their desire to do the job right# 

The real tragedy occurred when the operator mentally shif tied the 
burden of. acceptable work from his shoulders to the inspector# Evph 
with the best inspectors, the relationship between them ahd the fore- 
men and operators was one of an armed truce; the inspector was;;a 
friendly s^r# 

Obviously, this is an exaggerated and over-simplified pic|ttre of 
the pre-World War II inspection setup# Unfortunately, it is tjoier than 
we might care to admit# This general situation inevitably led to lOQ 
percent inspection arid severe final inspection as attempts tb Stem the 
tide of defective work t 

Fortunately, the impact of the manpower shortage, and the- gradual 
infiltratipri of statistics f^^^ pioneering companies in the 

field, forced cimnges to this concept# # 

I do not believe that any one individual sat 
our philosophy of quality control was archaic, but the minds 4^d atti- 
tudes of jnany people, c with the facts from the statistical 

usage, gradually evolved a new cpncept and philosophy of inspeciiSrir^ 
This was part of the evolution and development of today*s inspector. 

The reyplutionpiy changes have come during World War II §nd since# 
We now have a different picture of the inspector# Day to day 'we have 
had to rapidly shift our thinking to keep up with the technological 
changes of the last few years# 

the old cliche of ”it*s her|^ to stay** 
is applicable ^b inspectibri# W speculate what its f oim will 

be in the future# We want to look at what it is today and pohder over 
this part of our industrial complex# 

To talk about the specific job of an inspector, we will p "tart with 
a definition of our basic quality task# . 
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The Task 


The design and production of complex, high volume, multiple model, 
appliance type products with yearly changes in style and model 
places a severe quality responsibility on tiie operating management* 

Figuring strongly in the successful execution of this type busi- 
ness is the ability to design and build "trouble free" products* Prod- 
ucts that are immediately "free" from design and manufacturing mistakes 
which cause production stops and/or field failures* The vechicle for 
accomplishing this is a well planned, well operated Quality Control 
system from laboratory through production. 

The customers may buy for price and appearance, but consciously 
or unconsciously they expect their purchases to run trouble free and 
to have a guarantee in case they do not* Their friends are quickly 
told about the brands that are "no good"* 

In the case of the air conditioning business, the York Division 
of Borg-Wamer and other major manufacturers have five year protection 
plans with their refrigerant circuits| this requires design and con- 
formance quality good enough to run five years without failure. This 
industry is one that is new enough to have major technical changes 
coming one on the heels of the other; each one requiring major decisions 
and risk estimates that must figure into the five year warranty* 

A $1*00 mistake on 10^ of 100,000 units is a $10,000 corporate 
liability* A $10.00 mistake on 10^ of 100,000 is a $100,000 corporate 
liability* 

Certainly, costs are developed with reserves for guarantee 
accounts, but increases in these accounts have to be reflected in 
increased selling price or reduced margins; these are bad dreams to 
the salesmen and the treasurers. 

How "Good" Must The Product Be 

I spoke about the product being "free" from defects* 

The freedom is relative, and the degree necessary to meet ccan- 
petition successfully is established by the customer, the manufacturer, 
and the competitor* Each manufacturer designs and builds into his 
product, and perhaps advertises, a certain quality. Initially the 
customer doesn’t know what a BTU is, but he comes to expect a BTU 
quality, and gradually learns some of its meaning and other technical 
measures of quality. He begins to ask for it* The manufacturers then 
race to get the most BTH’s for the least cost* 

Eventually a commercial level of BTEJ acceptability appears as 
more or less standard. The decision each canpetiting company finally 
makes is how much better than barely acceptable does it want to be* 

The establishment of a given company’s goals in relation to com- 
mercial acceptance, service and performance, is the first high level 
decision necessary before a clean cut practical plan of laboratory 
to production quality control can be developed. 
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The control of quality of the type products in question is like 
huntingi the best opportunities jump up and are quickly gone. If you 
dpn^t know where your target is located, you can fire box after box 
of shells without hitt the quality in question. You mis ed the 
opportunity because after the first shots the quality becomes more 
difficult to locate; you have lost the easy killing shot. You shoot 
some game, but it’s more luck then skiH 

We all speak best about pur own experience so I will take the 
liberty of telling you how the York Division of Borg-Warner approached 
the control of quality from the laboratory through production* 

What Is The Quality Objective 

First, a very general but meaningful definition of the, quality 
goal wanted by the York Division of Borg-Wamer was established^- We 
selected: “The best competitive quality with a minimum cost for 
achieving this position,*’ ii 

This obviously requires further amplification. Take the first 
part, “The best competitive quality," How is it defined? hPlf, If ,11 
measured? Who raeasu^^^ 

How Is The Customers ’ Satisfaction Measured i 

We define it as the registered service complaints. The fact that 
these will contain both problems of design quality and conformaflce 
quality, is of no interest to the customer. He sees only defective 
product; so we measure pur performance in his terms regardless Of -rfi 
is responsible, v 

The measure of quality is percent defective of the installed prod- 
ucts, Eight to ten major performance characteristics are measured on 
each product. These are selected from records ^d opinions as Jihe per- 
formance quality items directly recognized by the customer, Thi char- 
acteristics are cpmiQ^, to air con^^ and ice making 

ment so we can chart by products and character is tics, !■ 

The data flows daily from all authorized repair men through the 
Service Department, Here it is collated Md sant^^^t^^^ Gontrol, 

This data presents the state of the unit; but is it good is 
it bad? 

Quality Control plots the field performance against the target 
for each characteristic, for a given month is calct&ated 

to consider the years the product has been installed, and is calcuiated 
by assuming that the occurrences of defects are linear with relation 
to tjjjie of installation. The monthly target caiculations are base^ 
on the five year target, 

How Are Quality Targets Derived 

The five year targets are developed yearly by Sales, Service, 
ibgineering, and Quality Control, Th^ are approved by the di^&sion 
and corporate management commit tees. These committees consist of the 
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division managers and corporate officers. Submission to the manage- 
ment groups gives them a chance to exercise their judgment and experi- 
ence in the final target establishment. 

How do we factually know that these targets will be better than 
our competitors’ performance? We don’t, but the persons selecting 
the targets are in the best position to hear and see about where our 
ccmpetitors are performing; their composite judgment has served our 
purpose well. 

How does the group selecting the targets know what the achieve- 
ment of these will cost in design and manufacturing? They don’t, but 
since the targets are developed as a must to meet competition in the 
areas the customer considers important, cost can be held as a second 
consideration. The cost of major changes required to meet a given 
target are weighed in terms of tangible lessening of customer com- 
plaints, but the decisions to make a major change are not totally 
accepted or rejected for that reason alone, as frequently customer 
dissatisfaction makes changes mandate ly. Naturally, when large sums 
are involved, considerable weighing of the tangible and intangible 
benefits occurs before decisions are rendered. 

The effort to achieve the target with a “minimum cost of quality” 
is the second part of the definition, and also requires explanation. 

What Are The Costs of Quality 

The costs of quality as we recognize them are: 

1, The cost of errors (both salvage and scrap) 

2, The guarantee cost 

3* The Quality Control Department operating cost 

U, The Service Department operating cost 

5, The cost of defective purchased material 

6, The cost of inspection and test facilities 

7, The hospitalization cost (the salvage time allowed in 

standard costs) 

8, Idle time and production losses due to quality problons 

90 Clerical cost of processing error replacement orders and 

salvage orders 

10, Cost of direct labor testing 

11, Space for inspection, testing and storage of reject 

material 

12, Shipping losses 

You may argue or add or subtract in your own case, but -we say 
that the sum of these costs should continuously decrease. 

Therefore our approach is singly to reach the performance target 
and spend less, and less to do it. 

Again the intangible or customer satisfaction sometimes upsets 
the cost of quality. You may be forced to spend more for inspection, 
a control system, or tooling then the actual saving in guarantee 
account dollars would indicate is permissible. 

We have found these cases to be the exceptions. Most times we 
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are able to have our cake of c^esire^ quality, and still elt our 

cake of lower cos-b of quali^ 

You may be starting to speculate on the reasons for such elab- 
orate emphasis on the quality goals and their measurement as reflated 
to laboratory to production controls 

Itot Is The Quality Control Department's <Job 

With this general background of the corporate quality objective, 
we will jump down to the task of the Quality Control Department* 
cons ider that its function shP^M ^Quality 

Control Department should act as the agency vdiich provides the '^for- 
mation where Oppfpniii^^^^ quality has been, where it is now, where it 
is trending, and how it can get back on course most quickly* 

Its responsibility is to focus the bright light of attentipn on 
the quality of the product so that the design and manufacturing time 
on new products is spent for basic corrections place where 

there is the greatest gain in custcaner satisfaction and the greatest 
reduction In the cost of quality, 

Ihspectiori Def ined 

We define inspection as the detemination of the acceptability 
of an item using the established standards as the criterion of^ 
acceptance. 

The place of the inspection organization in the industrial hier- 
archy can be argued many ways. We will not concern ourselves |^th 
this aspect, but try now to focus our attention on the task of ^ the 
inspector and his problems, 

The Inspectors* Dilemma 

Early in this talk I spoke about the cost derived fvm de|ective 
workmanship and product design quality. Consider now the misi^kes 

which can pp cur from Ihe defectiyQ 3^^ 

In the most modern plant there are many facets of the quality 
which can onlly be decided by the judgment of individuals. On a fast 
moving assembly line there is no practical instrument to say that the 
cabinet on this televisipn set is acceptable or unacceptable from the 
standpoint of Its painted appearance. If, in the inspector's "judgment 
it is defective, the wheels of a vast assembly line will stop,' It is 
seldom that we realize how much responsibility we place in the hands 
of a relatively untutored $1,80 an hour semi-skilled workman, ;; He can 
do thousands of dollars of damage in several minutes. 

The inspector is both judge and jury as far as the foremep and 
workmen are concerned. Every human being has certain personality 
traits and technical deficiencies which at besV^^w^^^ to mini- 

mize, These reflect themselves in his decisions as judge and 'jury. 

We expect the inspector to represent our corporate viewpoint j 
yet in most oases he is part of the bargaining unit. 
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We expect him to be flexible, but we demand that he does not 
compromise the quality of the proiict. In a sense we demand both 
flexibility and inflexibility. 

We ask him to become proficient in ferreting out the small de- 
fects of the product and criticize him when he quickly develops super 
skill. 

We esqject him to find every single defect in a fast moving assem- 
bly line when we theorize that 100/^ inspection is only 85^ to 90^ 
efficient. 

We demand that he have the ability of a tool and die maker, but 
are unwilling to pay him the same wages. We insist that he be com- 
petent as an operator, but expect him to think differently than an 
operator* 

He deals with for^aen, engineers, industrial engineers, production 
control men, yet he is an hourly worker somewhere between the middle 
and the top of the pay scale, often with little or no authority. 

We have given him no special training in diplomacy and tact, yet 
he should be the ultimate diplomat of the shop. He must be able to 
reject the work of his neighbor in such a way that they can ride home 
together as friends. 

We expect him to be a paper work expert and criticize when he is 
not spending eight hours a day next to the machinery* 

We insist that he be consistent from one day to the next and 
that he have infallible standards of judgment, but we are the ones 
who frequently ask him to change these standards. 

What Can Be Done For The Inspector 

These are the things an inspector is, and these are the things 
we expect him to be. Painted this way we gather the mental picture 
of an extremely confused man, and in many cases this is what we have. 
How do we end this confusion and have the inspector do the best job 
possible? 

First, let us spend some time in the selection of the inspectors. 
Through a rather involved process York has developed a selection test 
which picks persons who have the temperament that we have found best 
suited to inspectors. We pick only people who have high school educa- 
tions. We pick only people who have actual shop operating experience. 
Apparently, there is no substitute for the experience of being an ex- 
operator* We make sure the inspector is able to read blueprints well 
and most important, is able to understand complicated written 
instructions. 

Second - Define His Job 


Before we allow him to become an inspector, we make sure that in 
his own mind he understands the quality objective, the definition of 
quality control, and the definition of his job. 
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¥e tell him that he wears I'trst^ it is his job to deter- 

minegood and bad* Second, and most Sportant, it is his job to' help 
prevent defects by the intelligent discovery of defect trends as:; early 
as he can. We equip him with the rudiments of statistics. 

Third ^ Outline His Scope Of Authority And Responsibility 

We tell him that he must be flexible We 

show him that temporarily accepting a product with a minor defeqt is 
not conpromising his ethics, but this does not remove his obligation 
from quickly correcting the situation. We make sure that he under- 
stands the limits of and that he uses Jth judiciously. 

We point out to him the dangers of becoming super critical.. Most 
of all, we stress to him the importance in dealing with facts add tiy 
to develop a humble appreciation of his power in the shop without 
making a monster of him in attitude* 

We tell him his job really is to find the facts that preverit the 
defects. 

Fourth - Periodically Retoain Him 

We have come to realize that„ §ven the bejt periodically 

needs reaffirmation of all the precepts and concepts by which he is' ^ 
expected to operate* 

In those areas where there is a def to becom| buper 

critical, we periodically have him inspect selected items and tjgen dis- 
cuss his deteiminatipn of t^ as opposed to those of thq 

Service Department, Sales Department and Engineering Department. 

Fjf th Provide A Base For His Deoisions ........... .'J'.. 

We have also found that he must have a inference f or his nogm^^ 
decisions and a ueeuble policy. For this we have developed aih |hspec- ^ 
tion and quality control manual that is well indexed and can be]|^^ 
quickly for matters of policy and procedure. 

Placement Of The Quality Responsibility ^ 

In our industry there is still a cyclic nature to the business, 
and we have found that it is Impractical to hire and fire 

large numbers of inspectors yearly. In some ways this has been' a bless- 
ing, as we have had to realise . cpa?e';of in- 

spectors and thoir job must be more of an audit t]^ job of covering 
every nook and cranny. 

This has pointed out to us the urgency of quickly returning the 
basic responsibility for quality to the foreman jand operator an,S putting 
the inspector in the position of a helper and a fact finder. 

We have not de-eraphasized the inspector ’ s position, but we* have 
made sure that he is regarded as a helper in emergencies and normally, 
the auditor and fact finder. There is always the problem of maintain- 
ing this understanding between the inspectors and the operators, and 
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it presents a delicate task of daily adjustment to the chief inspector 
and inspection supervisors. 

It is something that will not maintain itself, but it takes con- 
stant and daily adjustment. 

So far I have talked about the inspector in terms of the human 
failings and strength of the two-legged variety of inspector. 

Mechanical Inspection 

Our modem quality control concept has led us to build into our 
equipment the inability to make a mistake and the ability to inspect 
for itself. It has also made us insist that the engineers design prod- 
ucts i^ich cannot be built wrong and the industrial engineers provide 
tools ^ich meet the same test. 

This has gradually led to a reduction in the number of inspectors 
required. Obviously, the choice between building in automatic inspec- 
tion and using inspectors is always an economic decision. 

Cost Of Inspection 

Gradually and inexorably there has been a trend toward a change 
in our old concept of the ratios of indirect cost to direct labor cost 
and the inspector is a part of this change. As our factories become 
more automatic and we use less direct labor people, we find ourselves 
being squeezed by the accountants because their old standards of meas- 
urement of the ratio of inspectors to direct labor men no longer hold 
true. Upon close examination, and honest examination, we find that we 
can build in more prevention and probably reduce our actual inspection 
force proportionate to the reduction in direct labor. This is not an 
economic axiom, but in our own experience we found that we were inclined 
to make excuses and say that we could not keep pace in the reduction of 
inspectors when we were competing with automation. The facts have 
proven us wrong, and with real effort we have been able to substantially 
reduce our inspection force. The reason for this is the increased use 
of control before the fact and a much closer working with the engineers 
and industrial engineers to build checks into our production equipment. 
But perhaps most important is the fact that we have better qualified 
inspectors on the job. 

Inspection Utopia 

I vould consider it a utopian situation if we reached iiie place 
where we would not need to define "what is an inspector”, because as 
a breed they had disappeared, I do this bit of philosophizing because 
no matter how we look at it, inspection and the inspector are necessary 
because of our failure to do a perfect job some-priiere along the line. 

We can only be satisfied when these failings no longer exist and hence 
there is no longer a need, 

I hope that by looking into the past and talking about what an 
inspector was and what he is today, you have gathered new ideas about 
what he should be in your industry tomorrow. 
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OPERATIONS RESEARCH IN BUSINESS 

AND INDUSTRY I 

Leonar^i W. Swanson 
Arthur Andersen & Co, ; 

INTRODUCTION 

Definition 

Operations Research (l) (2) or OR as it is often dialled 
is a reratively new field of endeavor . It has been in, exist- 
ence for approxiiHiately 15 years under that name although 
there are isolated examples of its use many years prior to 
that time. Briefly OR is the application of the scientific 
method to decisiQn making. The quality control specialist is 
well aware of the importance of the scientific approadlh to 
certain problems of decision making. Quality control might 
well be included in the area Pi operations research bqt JAp 
not intend to elaborate on that point. 

His tori Q al Back ground 

Operations Research had its real baginn^ durin| World 
War II when the varipus military agencies employed sciehtifi- 
cally trained personnel to assist in the improvement of mili- 
tary operations. These scientists were extremely successful 
in aiding commanding officers with the many complex problems 
that faced them* In arriving at solutions to these problems 
it was dempnstratad that pur scientific knowledge 

could be applied to many of the complex problems of manage- 
ment that had previously been handled by intuitipn or;;^ 
ment. Since the war many OR groups have been formed 
in the solution of m problems. These teams |re used 

primarily in aiding executives by giving a quantitative eval- 
uation of the alternative,. d^^ that might be made-- the 

executive however must still make the decisions. | 

Method of Attack 

typically, a problem is attacked by first defining the 
goal of the operation in a clear and cpncise manner. ’This 
includes the definitipn of the problem together with Jhe meas- 
ure of effectiveness to be used. Many times this portion of 
the problem requires more work and time than any of t^e other 
phases. The second stage involves the construe tipn of the 
model which may or may not be mathematical in nature.;; This 
phase of the problem includes the collection of the pertinent 
data, which in itself is often time-epnsu and costly. 
Follpwing the collection of the data, a third phase consists 
of the splutiph of the problem together with the testing of 
the model for accura of representation. At this point It 
may be necessary to alter the model in the light of the test- 
ing that has taken place. If a new mpdel results, then it 
must be retested. Once a satisfactofy model hasbeeuicPh- 
s true ted, arid solutions have been pbtalhe<i> it is necessary 
to present the results in terms of a workable operation. 

This final phase is extremely important since it presents 
management with the various alternative epursespf action to- 
gether with an evaluation of each. 
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Range of Prolplems 

The range of problems (3) (4) being handled by Opera- 
tions Research methods is extremely broad. The fields of 
application are in such widely scattered areas as administra- 
tion, production, inventory, manufacturing, transportation 
and research. Your Administrative Applications Division of 
the American Society for Quality Control was organized ’’to 
promote the installation of statistical techniques in adminis- 
trative fields.*' The opportunities for your using OR methods 
are essentially unlimited. In order to assist you in estab- 
lishing the nature of Operations Research some pertinent exam- 
ples are given in regard to several specific areas, 

INVENTORY CONTROL 


Inventory Costs 

Inventory problems (5) arise because of the conflict of 
operational costs--these costs fall into the three main cate- 
gories of Procurement, Possession and Shortage. In the area 
of procurement are all the costs associated with each order 
for replenishment. The total procurement cost depends upon 
the number of orders placed during a period of time. Posses- 
sion costs consist of such items as warehousing, interest on 
capital, insurance and obsolescence. Investment in inventor- 
ies can commit a considerable portion of a firm's capital-- 
consequently savings from using modern methods of inventory 
control can be Important, The third important cost asso- 
ciated with inventory problems is the cost of a shortage. 

Measure of Effectiveness 

Although the measure of effectiveness used in connection 
with inventories is not unique, one measure that is often 
used is the total variable operating cost. If such a measure 
of effectiveness is used, then the problem becomes one of 
determining the policy of handling the inventory so as to 
minimize the sum of procurement, possession and shortage 
costs. Since it is extremely difficult to assign a cost to 
the shortage of a particular item, the problem is often 

rephrased in terms of an allowable probability of an outage. 
Management is usually willing to specify a criterion in this 
area by specifying for example that it is permissible to run 
out of a particular item once in five years or whatever per- 
iod of time Is appropriate. 

Economic Order Quantity 

On the basis of establishing the quality of service by 
means of an allowable probability of an outage, it is then 
possible to establish an Inventory management policy which 
will meet the service requirements and determine order point 
and order quantity so as to minimize the costs due to pro- 
curement and possession. For each inventory item at a store- 
room, there is a variation in quantity balance. When the 
inventory reaches the level "K", called the reorder point, a 
quantity "Q", called the reorder quantity, is ordered. The 
lapse of time until the order is received (called procurement 
lead time) is extremely important in determining the reorder 
point. Formulas for economic order quantities are fairly 
well known and the rather standard 
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2YS 

“Tf 


is usually acceptatle* In this formula: 

Y « annual use of item in physical units 
S » procurement cost per order 
Is possession charge In per cent 
C s: unit cost of item 

Reorder Point 

The methods of determi^^ reorder point ar# not so 
well Icnowh hoveyer. Historical data on usage is of course 
extremely important. Such data is fit io an appropHa^ 
curve, usually a Poisson distributio^ (6). This usagd pat- 
tern, together with management's decision on 

ages, provides the necessary information for determining the 
reorder point. 

Implementation 

If means of automatic data processing are availa|fle, the 
computations can he handled quite easily. Such a coffl|uter 
operation would determine when the rew point had peen 
reached and then determine the quantity to be orderedV This 
would he done on an exception basis, printing the pertinent 
information on those items which need attention. If comput- 
ing equipment is not available then charts or nomographs caii 
be used. In any case, the reorder point determination is 
closely associated with the Poisson dis^ri^ as dj^ter- 

mined by the past usage of the item. 

Value 

This is a relatively simple method of inventory control 
--much more complicated ones have heen dev^^ However, 

the attention that many firms give to the economic control of 
their inyentpry is so small, when the size of the investment 
is considered, that very real savings can be achieved’’. Sev- 
eral cases in our experience have shown cost reductions of 
hundreds of thousands of dpllare per year for even moderate- 
sized firms. M 

INFORMATION PMBLEMS 

General 

Probl ems. . in . th is ,are,a,.,^ arise. „ ^ when^^.; c;e r.t ain, 

needed. There are both errors and costs associated ^j'ith the 
process of data collection. The problem to be discuesed here 
pertains to the railroad industry although a similar ;:applica- 
tlon has been made in other transportation fields. 

Revenue Estimating 

The problem here is to obtain an estimate 
road's full carload reyenue. This represents revenue actu- 
ally earned for a specified month with the stipulation that 
such informatipn is to be available within the first ^f ew days 
after the close of the month's business. Such information 
cannot be obtained on an actual basis without going to ex- 
treme expense since the normal process is to wait for; a 
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report from each of the final carriers. Such information is 
never available until the latter part of the month and some- 
times not until 60 to 90 days later. The revenue estimate 
had not been a problem until recently, since the accounting 
reports were normally rendered about the 25th of the month. 
With the installation of a new accounting system such reports 
were to be made no later than the 10th of the month, and 
consequently it became necessary to devise a means of deter- 
mining that revenue. 

Scientific Sampling 

Often many different railroads handle a particular car 
and the actual computation of the apportionment of the reve- 
nue to each of the railroads is quite a task. Historical 
Information can be used to determine revenue per car but such 
figures vary so much from month to month that average revenue 
per car methods did not seem advisable. The labor involved 
in complete computation was so large that consideration was 
given to obtaining the estimates by taking a sample of the 
traffic on a random basis. Sample estimates are not only ac- 
curate enough for management planning but surprisingly are 
often more accurate than a 100^ determination. Scientific 
sampling (7) takes into account the revenue characteristics 
of the various commodities hauled as well as the variations 
due to ^seasonal effects. Monthly revenue characterisitics are 
studied in order to assist in designing the sample. 

Classification of Traffic 

There are four classes of full carload traffic handled 
by the railroad. These are (a) local, handled completely on 
the line; (b) interline received, started by another railroad 
but finished on the line; (c) interline forwarded, started on 
the line but finished elsewhere; and (d) intermediate, started 
elsewhere and finished elsewhere but carried intermediately 
on the line. 

Sampling Procedure 

At the present time, the revenue for local traffic is 
the only one which can be obtained on a 100 % basis without 
undue expense. All other classes of traffic would require 
excessively costly procedures to obtain complete revenue in- 
formation and so it is in this area that the sample is chosen. 
On the basis of the accuracy required, a san^le size of 1 in 
15 was chosen for the nonlocal traffic. Worksheets have been 
drawn up on the basis of using 10 subsamples. Carloads are 
chosen from appropriate reporting forms by the use of random 
numbers and, for each car chosen, the revenue due the rail- 
road is computed and entered on the worksheet. The totals 
for all apportionments are obtained at the end of the month 
and multiplied bjr fifteen in order to obtain an estimate of 
nonlocal revenue which, when added to the local revenue, 
gives an estimate of the total full car revenue. Adjustments 
to this figure are made on the basis of other reports in 
order to obtain the total operating revenue for the railroad. 

Standard Error 

The division into subsamples is made for the purpose of 
facilitating the computation of the standard error of the 
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estimate . The standard on a eumala*tive basis 

to reduce throughout the year until the final figure is less 
than 0,5/K/ This means that there is tiat the 
error due to sampling is less than 1^. 

Advantages 

The procedure descrihed for est^ revenue has sev- 

eral particular advantages. These are: 

1. The cars are chosen fr^ actual traffic : and, 
hence, no historicai information is needed, Unusual 

< traffic characteristics will be found by the sample, 

2. Changes in freight rates do hot alter the 
procedure, except in computing the apportionments, 
at which time the new rate sc^^^^^^ 

3. Accuracy and correspohdlhg risk hP 
estimate are determin^^^^ precisely. 

4« Revenue estimate is ayailjible by the 6th 
of the month, 

5, Costly and inaccurate carry-over reveniijB 

computations are eliminated. J; 

6, Railroad personnel can carry out the plan 
after it is set up. 

Since the cost of making revenue apportionments is ex- 
tremely high for any railroad, serious consideration shou^^ 
be given to using sampling for the actual settlement of inter- 
line accounts. The er?*03?s due to the sampling could quite 
likely be more than offset by the savings effected. Sever al 
airlines have already adopted this progressive move in 
accounting, 

PRODUCTION ALLOCATION 

Changing Market 

The market for some manufactured goods changes rapidly, 
and consequently manufacturing facilities are not always in 
balahce with the re^ for production. The purpose of 

the following example is to indicate a method of approach for 
the proper allocation of production to available man 
ing plants so as to maximize the profit over a specified per- 
iod of time. The method may be used for either longirahge or 
short-range planning. If the demands for each of a iroup of 
products are knom, a^^^ the^^^^^r^^ for producing these 

products are also known, then it is possible to determine the 
optimum allocation of production. As an illustratiQhj consi- 
der the situation created by the reduced demand for i series 
of products which are presehtly being manufactured ih several 
plants. On the basis of fprecast demand for^^^ to products, 
the allocation of production can be determined so as |o mini- 
mize the total variable cost. 

Capacities and Demands 

To be specific, consider a 7-plant operation. Suppose 
that the plants are allowed the option of operating on a 2- 
shift basis. Since the capacity for production is u|uaily 
different on each of toe two^ let these be designated 

as Cl, f C14, Where Cl, a3ld C2 are the first 
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and second shift capacities of the first plant and so on. The 
measure of capacity used is not unique hut probably would be 
square footage, direct hours of labor or something similar. 
Suppose there are 100 products being manufactured. Let 

D 2 / D 3 , , I^lOO demands for each of these 

products* It is important that these demands be given in the 
same units as the capacities of the plants. 

Cost Matrix 

It is first necessary to determine the cost associated 
with producing each of the products at each of the plants. 

In order to reduce the computation, only the costs which will 
vary with a change in location of the production will be used. 
Thus the cost of the material for making the product may not 
enter as a variable cost, since the cost of the material will 
usually be essentially the same at each plant. The items of 
cost which are likely to enter as variable are the cost of 
getting raw materials to the plant, gas, electricity, taxes, 
material movement in the plant, cost of direct labor if rates 
vary between plants, distribution cost of final product and 
possibly several others. The task of gathering such informa- 
tion is sometimes sizeable. The costs when gathered are then 
arranged into a variable cost matrix as shown 

COST MATRIX 



Plant 1 

Plant 2 

Plant 14 

Demands 

Product 1 

Ai,l 

Ai ,2 


Ai,14 


Product 2 

A 2,1 

A 2,2 


A2,14 

D 2 

Product 3 

11 

11 


II 

II 

It 

It 

II 


It 

II 

ft 

If 

If 


11 

11 

ti 

11 

TI 


11 

II 

Product 100 

Al 00 »l 

Al00»2 


A100j14 

DlOO 

Capacities 

Cl 

C2 


Cl4 



Optimum Allocation 

The completed matrix presents the variable cost for 
manufacturing each product at each plant. Up to this point 
it has been assumed that each product could be produced at 
each plant--provisions will be made later for handling var- 
ious restrictions on production. If, now, one uses the nota- 
tion that Pij represents the amount of product 1 to be allo- 
cated to plant j, the total variable cost of production is 
given by 

Cost = -AloO, 14^100,14. 

The specific goal here is to allocate production in such a 
fashion as to minimize the cost given above while satisfying 
the demands exactly and yet not exceeding the capacities of 
any of the plants. The demands for each of the products have 
been added as a right-hand column in the cost matrix and the 
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capacities are given as the bottba line in the 
Linear Programming 

' Since it is assumed that the variable cost of producing 
a given product at a given pi dnt varies direct as the amount 
produced, this problem becomes a linear programming (8) one. 
The assamption is essentially correct unless the amo^^^ 
cated to a given plant fail below a 70^ usage of that ;piaht 

Furthermo^ if the total of all of the demands is 

equal to the total pf all the capacities, the problem freduces 
to one which can be solved by the "transportation" me|hpd. 
Actually a likely situation is that the total 
less than the total capacity and consequently it is hpt a 
true transportation probiem. Because of the reduced computa- 
tion in the transportation type problem a fictitious product 
is added in order to make the problem come under that,, classi- 
fication.' ■■■■ 

Computer Computations r 

The computations to determine the optimum solution can 
be carried out very nicely on an intermediate-size| cpjteputer, 
and a solution has been obtained for a similar-sige problem 
in approximately an hour^s machine time. lihal e|)lM 

must be examined carefully to make sure that it is re;h1listic. 
In case adjustment must be made to the optimal soiutipn, the 
additional cpsts due adjustments can be dete.r|ttined 
quite easily. 

Variations on Problem 

There are sdVCral rami fic ations to this problem '“which 
should be pointed out. above discussion 

has been based upon the assumption that there is no V;ariatipn^ 
in fixed costs. If demand should drop considerably there is 
the possibility of closing a plant — which in turn would lead 
to a reduction in fixed costs. _ If one then allows a "p^ 
to be closed the fixed costs become variable and any navi^^^ 
in this area must be added to the savings in what has' pfe-^ 
vlously been termed the total ya^iabl^e cp^t, to dete:|mine the 
ultimate savings. If costs are associated with the |hifting 
of production from one plant to another, these costs must be 
applied against the sayings. In some cases it is pp|sible 
to incorporate the costs of shifting production in the cost 
matrix itself, 

Restrictipns 

In the cost matrix, certain artificial restrictions^ 
be incorporated. For example, should management indicate that 
it is impossible to produce a given item at a given Mant, 
that particular cpst can be assigned arbitrarily high in order 
to prevent that allpcM production, A similar 'assign- 

ment can be made to the costs associated with eacj^ 

a particular plant, particularly if management desires to see 
the effect of clpsing a particular plant. Proper design of 
the computing procedure also makes it possible to change all 
the costs associated with a , particular product, should such 
be desired. Suph a design also makes it possible to evaluate 
either the addition of new products for long-range planning or 
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the elimination of the production of certain products from 
the line. 

Savings 

The procedure described above has actually been carried 
out in several cases. One of these resulted in an annual 
savings in excess of one million dollars. The procedure is 
flexible enough that it can be carried out quite easily pro- 
viding the appropriate data is available. 
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FRACTIONAL m 

Outlibert Daniel 
New Ypi^ city 

I propose to talla;: oii two aspects of fractional repll- 
oation in the SP-Vsfries; Vlrst on sequences of fraotional 
replicates and then oji improved errpr-eatiraation* Eacji 
of the two proposals inade pelpw Is aimed at redressing, 
partially at least, one of the outstanding defects of;' 
fractional replication as usually practised. 

The first dpfect is tMt of size. If eight factors 
and all their two factor interactions roust be estimated, 

64 runs ( treatment combinations ) must be made. If fu!ll 
randomization is enforced, no conciusipns can be drawn; un- 
til all runs are completed. The second dafept is the ;lack 
of a proper error tern In the stands^ 

Sequences of fractional replicates 

Let us suppose that it is desired tP obtain pstirpates 
of the first-order, effopts of p factors, independently 
variable, and of their p(p-i)72 two factor Interactions. 
There ai*PV then, p(p-fl)/2 mutually unoonfounded estimates 
required. For p m 6,8,11, the minlrou^^ numbers of run# re- 
quired are 32, 64 and IgS. But it often happens that, after 
one of these large sets has been completed, most of tfie 
factors varied and roost of . the two factor interaction| 
appear to be of small influence relaiive to the other|. 

The experimenter may feel that he could have found thf 
bigger effects in fewer that he had to wait top Jlbng 
to discpyer the major effects. If only a part of the '"whole 
design could have been completed first, he might have -been 
able to say either: ^ 

a. Factors A, D and E show that t^^ are far and away 
the most Influential in the present ran^^ of |heir 
variation. I can draw my conclusions now. OrJ; 

b. Factors A, D and E appear most Influential bp^^^ 
must have better estimates and I must know mo|*e 
about their interactions in the range of variation 
under study. OR 

c. Changing A made a big improvement* I want to,, in- 
crease It still more . There is no point in opntin- 
ulng experimentation with the present range. OR 

d. Nothing much shows up, but my experimental er^bpr 
looks aurprlsingly large. We'll have to do anpther 
round to increase pur sensitivity. 

Consider, as we mathematical statisticians say, the 
half-replicate of the 2^ ( called here a 2^-^ ) requiring 
32 runs which gives all six first-prder effects a^ all 15 
two factor interaptlons ( abbreviated 2 f.i. from npw bn ) 
mutualiy unconfoundpd. Of . course since it is a half j^r^epli- 
cate each of these , must be , confounded with something, and 
the cryptic rubric - 
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I 4 ABGBEF 


shows what is measured along with what* As examples: 
the main effect of varying 0 is measured along with the 
five factor interaction ABDEP; the 2 f.i. DE is measured 
along with ABCP* No smaller factorial experiment will 
messuage all 15 2 f.i. and all 6 main effects mutually 

unconfounded, but there is a set of 16 runs, half of the 
above half rep* and therefore designated , that 

will permit estimates of all the main effects. Of course 
this set of 16 runs, being a quarter rep. produces contrasts 
each of which estimates the sum of four effects. The best 
that can be done is to permit each main effect to be measur- 
ed along with one 2 f.i. The confounding pattern is given 
t>y 

I - ABC - DEP 4 ABCDEP. 

Thus the "A contrast'* measures A -* BC - ADEF 4 BCDEF. 

The 16 runs are specified by the four "generators", ab, 
de and ef. Multiplying these together in all combinations 
and adding the run designated (1)- meaning that wlil> all 
factors at their low levels- gives the 16 runs required. 

If after analysis the experimenter opts for completing 
the 2 f.i. -clear design, he has only to do the 16 runs 
derived by multiplying the set already specified by ad. 

Similarly for the other favorable but large fractional 
replicates in the 2P‘*Q series. There is for each a most 
favorable ( or least unfavorable ) sub-fraction, 2^**^**^, 
that will separate and detect large main effects. For p » 8 
the smallest 2 f.i. clear plan is the 2^"*^. The eight main 
effects can be separated from each other, but not from the 

2 f.i* interactions, in 16 runs, thus in a 2^"’^"’^. 

A confounding pattern for the 2®"’^*^ is given by; 

I - ABC - ODE - EFG - GHA 

4 ABDE 4 AEFH 4 BCGH 4 BDPH 4 CDPG 
- ABDPG - ACDPH - BCEFH- BDEGH 
4ABCEFG 4 ACDSGH. 

The four 3 f-i* can be taken as generators. The underlined 
interactions are viewed as the ‘‘permanent members". These 
three give the confounding pattern of the 2 f.i. clear 
2®’*2 (iesign that the experimenter may have to complete. 

The first 16 runs may be generated by hab, bed, def . fp;h 
If another set of 16 runs can be done, then three of the 

3 f.i. can be removed from the confounding pattern. For ex- 
ample -ABC, -CDE, and -EPG are removed if the second set of 
16 runs is generated by times each member of the first set 
The multiplier must be odd with respect to the three removed 
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3 f.l. but even with respect to the underlined memberej. After 
dgihs the first 16 runs, we are not comiDitted only to :the 
2^-2 specified by the underlined three interaotlons. phe 
three not underlined ( two fives and a six ) give us the only 
alternative. Thus if it was decided that -ODE, <-EF& and 
•KH! A should be eliminated, then the new 16 runs are g^nerat- 
ed by dg times the old set, but this puts us definitely in 
the 28^ defined by the 5 and 6 f.i. not underlined^ 

Partially duplicated fraotioiial renlicates 

**In certain situations** as we say when we cannot speci- 
fy them exadiy, it is important that a fairly unbiassed 
estimate of the run-to-run error be obtained. The InAfeterate 
habit of pooling higher-order Ihteractldhs tends to spread 
to the 2 f.i. since there appears no comp^lll^ reason why 
the latter should be in a qualitatively different category 
than the 3 f*i. Of course whenever a 2 or a 3 f.i* lod|ka 
big, we quietly snatch it from the pool and test its 'lislgnl- 
fi canoe**. 

A natural compromise between this disreputable practice 
and the expensive blamelessness of full replication is that 
of partial duplioatibh. Some run repeaiied 

but hot all. It only remains to decide which, and to show 
the consequences in analysis and in interpretation. :| 

To take a simple example first, we choose a 2^ with 
half its. runs replicated. We will designate this as S' 

2^ 4 Use I - ABC for the half-rep.; call the usual, 

difference between the sum of all results at high A 1 
and the j5um of all results at low A (A) ; and let the 
symbol A stand for the estimated average A-effect . 

By standard least squares operations, or by inspectibh, 
we find pairs of normal equations like these; " 

(A) « 6 A - 2 BO 

(BC) s-2 A 4 6 BG , 

From these we find: 

16 1 a 3(A} 4 (BC) 

16 BC « (A) 43(BC) 

Also the variance of each of the estimated effects is ^/S 
of the run- to-run error variance, and the correlation Be- 
tween the pairs that appear together is -1/5. Those that 
appear in separate pairs are uncorrelated. Thus simliar • 
equations and similar relations hoid for the pairs B and AC, 
and 8 and JC&. The among-run error variance is estimated with 
only four degrees of freedom in this example, by 1/8 tjie 
sum of squares of differences between the four dupilicate 
pairs of runs. 
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A more serious example Is given by the half-replicated 
25-1^ The full half-ret?. may be assigned the confounding 
pattern I - ABODE. The duplicating quarter-rep. is given 
the pattern I - ABC + DE - ABODE. The duplicated runs are 
those generated by and j^. The unduplicated runs 

are found by adding the generator ad . 


Two sorts of pairs of normal equations emerge. 


(A) - 12 ^ 

- 4BC 


(D) 

s 

12 D 

+ 4 E 

(BC). -4 r 

♦1235^ 

and 

(E) 

a 

4 D 

+12 E 

Their solutions 

look like 

this; 





52A •> 3(A) 

+ (BO) 




3(0) 

- (E) 



and 

32D 

s 

32BC - (A) 

+ 3(BC) 




-(D) 

4 3(E) 


32E 

s 


I am indebted to Mias Edith Reid who showed me the useful 
shortcut of carrying through the usual Yates algorithm us- 
ing the sums of pairs where they occur, to obtain the values 
of all the contrasts simultaneously 


The 2®“*^ can hsve a in 16 runs appended for 

error estimation in the same way. For the full 
the best confounding pattern is given by 

Qi a I - ACDFH - BDEGH 4 ABCEFG. 

For the duplicated runs, use 

Q2 « ( I - ABO - ODE ) X . 

Pour' types of groups of normal equations appear. Their 
solutions ^re also^iven. 

I. For A,BC,GH; 6,DE,ife; and S,Xh,^. 



8A 

8^ 

8GR 

(A) 

(BO) 

(GH 

1) 

5 

-1 

-1 

1 

0 

0 

2) 

-1 

5 

-1 

0 

1 

Q 

3) 

-1 

-1 

5 

0 

0 

1 

4) 

28 

0 

0 

6 

1 

1 

5) 

0 

28 

0 

1 

6 

-1 

6) 

0 

0 

28 

1 

-1 

6 
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II. For and 



siS 

SBO 

Qm 

(AE) 

(BC) 

(FH) 

7) 

5 

1 

1 

1 

0 

0 

8) 

1 

5 

1 

0 

1 

0 

9) 

1 

1 

5 

0 

0 

1 

10) 

28 

0 

0 

6 

-1 

-1 

11) 

0 

28 

0 

-1 

6 

-1 

12) 

0 

0 

28 

-1 

-1 

6 

III. For 

B,^; D, 

CE; F,EG; and H,AG 






00 

8AC 

(B) 

(AC) 


15) 


5 

-1 

1 

0 


14) 


-1 

5 

0 

1 


15) 


24 

0 

5 

1 


16) 


0 

24 

1 

5 


IV. For AD, BE; ^ 

;:Si; bf,dh; b&,ch; 

and 

CF,m. 




Sad 

8BE 

(AD) 

(BE) 


17) 


5 

1 

1 

0 


18) 


1 

5 

0 

1 


19) 


24 

0 

5 

-1 


20) 


0 

24 

-1 

5 


Summary 








1. A method of ordering parts of fractional replicates 

in the 2P“*Q series has been outlined so that large e^^fects 
can be detected or ruled out before the full set of r^ns is 
completed. . f 

2. The design apd analysis of partially duplicated 
fraotiCnal replicates has been sketched. The purpos# of 
partial duplication is to secure a less biassed erro# esti- 
mate. The disadvantages are that a slightly greater 'com- 
putational effort is r©Qulred, that small intercorrejiattons 
between some of the estimates are present , and that |l slight- 
ly larger variance per run is obtained. 

3 * The combination of these two oompromises is |n 
preparation. 


233 



234 



QUALITY CONTROL’S OBLIGATION TO l'lAKAGSi®iT AND 
CUSTOMER ON RELIABILITY OF COI^Plix 
BY 

ALMERON BEDFORD 
REDSTONE ARSENAL 


Gentl^en, I speak here today as an individual and not 
official capacity as a Government employee. 

There are a lot of hi^ words in ttie subject of today^ discussipn. 
Big words lead to big definitions and then the fun begins. It *s 'like 
the th3?ee Frenchmen trying to e:>qplain to an Englishman the inabi3.ity 
of the wife of one of them to have a baby. The husband said she , was 
**unbearable|" the second corrected him and said she was ”inconce^^ 
blej" and the third tried to iitprove on the others with his definition- 
the womanL was "inpregnable,*” 

And so it is with Quality Control - Quality Assurance, Reliability, 
Accuracy, Satisfaction Guaranteed, or what have you, I’m sure we all 
have the same basic idea in our minds, but ve clothe it with different 
connotations in accordance with the usage dictated by our past 
experience or the school of thought with which we are most faMJ^ar, 

Webster only contributes to thse confi^^^ a dozen 

different definitions of ’'Quality," When we use it in the fiel4 of 
Guided Missiles, we prefer to think of Quality In terms of 
''DISTINCTiyS QHAIUCTERIiTICSv'V - that can be 

recognized, defined and measured so that they can be specified and 
designed into the product and be sufficiently identifiable to ni|ke 
it possible to determine later ^diether or not they are actually in 
the finished product, '! 

Quality - as we see it - is the key to successful performance - 
it must, by its very nature, be specifically aefined to the last . 
distinctive characteristic. It’s eit^^ or wrong - there can 

be no compromise, 

3p, if we can get this picture of Quality as a set of definable, 
recognizable, measureable - distinctive characteristics - th^^ 
start talking about our two basic responsibilities : hpw to get 'this 
required Quality into pur Guided Missiles in the first place - |uad 
then how to reassure ourselves that it is actually there in the" 
finished product, the se^^^^ 1 

So that you will better understand pur jgroblem, tho, let’s digress 
for a mpMnt to d^ between Quality Control as practiced 

generally in industry and as we visualize its function in the Gjxided 
Missile field. 
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In industry, the guiding factor in the inplementation of the 
Quality Control concept is the cornpetitive market that must be 
considered in the battle for economic survival. The product will 
not necessarily be the best, or the worst, that can be made, but 
must be of a Quality Level - somewhere between the two - which will 
appeal to the greatest nuinber of potential customers - at a price 
they are willing to pay - and at a manufacturing cost that will 
allow for a reasonable profit. In arriving at this level of quality, 
industry frequently can also take a calculated risk. If manufacturing 
costs can be reduced at the expense of causing one failure in ten, but 
at a savings in production costs in excess of the cost of one unit - 
they caii afford to replace the defective unit free of charge and still 
make more money than on the original operation. But, we can*t take 
risks of any kind - calculated or otherwise. The ultimate customer 
is the enemy and if we deliver a defective unit at a critical time, 
there will be no chance to replace it "free-of-charge.” It may mean 
the difference between a missile hitting or not hitting some vital 
installation. We have Just one consideration - or problem - and 
granted it»s a big one. We have to produce the most effective and 
reliable product that the tactical situation calls for - within the 
limits of human capabilities - and regardless of cost. Within reason, 
of course, but who is going to place a price tag on survival, beyond 
which we will not go? If an iron rivet will do the job - certainly 
we will specify and use iron rivets. But, if we can only design 
missiles that will only function properly with solid gold rivets - 
then, by golly - we *d better use gold rivets if necessary, until Fort 
Knox goes dry. 

Now, of coiirse, we are both customer and manufacturer, and while 
the former considerably outwei^s the latter, we do have an understand- 
ing of both sides of the fence. In addition - even where we are the 
customer - because of the fact that Guided Missiles are so vital to 
our very continued existence - the Government has assumed the pre- 
rogative of going into the manufacturer »s plant and exercising the 
function of Controlling Quality. It*s accomplishment is either di- 
rectly by the Government’s own personnel or indirectly by Government 
surveillance of the Contractor’s Quality Control personnel. It is 
primarily an inspection function, but because of factors which go 
beyond routine inspection in the course of assuring ourselves that 
the required quality is really there, we have defined this fanction 
as Quality Assurance. It is not to be confused with Quality Control 
which provides for the original inclusion of the required quality in 
the design of the product, but merely reassures us that eveiything 
has gone according to plan - or if not, of course, identifies the 
trouble spots so that necessary remedial measures can be instituted 
at once. 

That brings up the question - where does Quality Control begin 
and where does it end. In its broadest sense, we believe it starts 
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with the first lijfie on the draw^ board and ends when the miss^ 
hits the target. It me^ taking every possible, conveiyable, 
reasonable step to make sure that the end product is as effective, 
reliable, accurate, dependable arid efficient in terms of the mission 
to be accpraplished that it is hui^ly possible to produce. Sure:, iS " 
need qualified quarterbacks to call the signals - sort of trouble- 
shooting efficiency experts - but. Quality ” achievemeht " is eve:^bo<^*3 
business and the cost is eternal vigilance for everyone cbhriected with 
the business of supplying materiel to the Armed Forces, 

We reach a point here of ciivided opinion. Many differentiate 
between Quality Control as we have defined it and Reliabi^^ 

Basically;, this is a fallacious as sxirnption, for if the product has 
been properly conceived, designed, manufactured and handled i^ 
be reliable or else the original Quality specifications are wrong. 

If it hasn't the right quality designed and built into it in the first 
place, it never will be reliable. Now, if con^roraises have beeh 
effected with the original Quality specifications, if specif ied, pro- 
cedures have not been followed, or any of a hundred other possible 
abuses of the system as originilly conceived have occured, theri^ of 
course, reliability is affected. It all goes back to our premij|ie that 
the product must have the right Quality specifications to begin with - 
granted there will be trial and error before the final specifications 
are crystalized. You can put com syrup in the gas tank of a | 
Cadillac and ruin the engine. Reliability has been destroyed, but 
vcp to that point the desired quality and the potential reliability 
were both present. In other words, reliability could be defined as 
the prevention or elimnation of all possible abuse or misapplication 
of the original quality specifications. But, again it all boils dpra 
to the basic objective and regardless of what you call it, you begin 
to visualize the n^gnitud^ of the problem that faces our engineers. 

Our Specification Writers, etc.j first in determining what the correct 
qualities are - specifying them, and then seeing that they get into 
the product. It would be easy enough to throw discretion to tj|e w^ 
as is often done in war time or cases of extreme national emer|ency - 
but, they are no more snxipi:^ to desiroy the solvency of the 0^61*01^ 
in peace time than they are to see our country improperly defended in 
war time. 

Where we are convinced it will affect the efficient f^ctipn^^^ 
ing of the missile, or any part, we do specify certain tolerances 
which lie within the specified qualities. And where it is, by the 
same token, possible to specify the industrial conception of a "low 
quality" product (the iron rivet against the gold rivet) we do just 
that. But, when we do approach these limits of acceptability as 
closely as we dare, we must then insist on e^ct compliance, Jh 
have a phrase for it at the Fran^ord Arsenal Military Specif ipatlon 
School - Minimum Requirements (in quality) but, Maxijrium Severity 
(in meeting those requirements). 
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There's a psychological approach here, already covered briefly - 
one that perhaps lies in the field of Human Engineering. Its our 
feeling that Quality Assurance, lets call it - should be eveiybody's 
responsibility - not just that of a group of specialized trouble 
shooting, efficiency experts. It's too big a problem to solve with 
regulations and supervision alone. The human element is too paramount 
in every phase of the operation and without the personal cooperation 
of everyone connected with the program, the best laid plans can con- 
ceivably go haywire. Granted every step should be taken - people 
being only human - to eliminate the human element as far as possible, 
but we still have to consider it in all its potential notifications. 

Industry can afford to be opportunists - we must be perfection- 
ists. 
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OmANIZIKG TOR AIRCiRACT QUALITY COTOOL 

Herbert B. Epstein 
Chance Vo\j^t Aircraft, Incorporated 

IntroduPtion 

In order to describ^^^^ you gentlemen tbe scope of Quality Con- 
trol as practised in the Aircraft Indi^stry I have arranged f or ybiir 
review a series of illustrations which show in general chronological 
order the development of a Quality Control 'organization and system de- 
signed to keep pace with the ever increasing coiig)lexity of aircrkft and 
guided missiles/ . 

Althoxigh this experience is principally Chance Vought Airci*^t 
experience it may be noticed in the eyplutioiix^^^^^^Q^^^^^^ Coijibrol 

function that the coiasideratiocg. for eypl^^ function are ^ifunda- 

mental to the entire field of Cliialfly^lSont^ -- i| . 

Evolution of Quality Control Function 

Inspection 1946 - From the inception of Chance Voxight Aircraft to 
1946 the Quality Control functipi; consisted principally of inspecting 
aircraft from the raw mterial phase throu^ to the consisted airplane • 
However, in 1946 it was i^cogHzed by^M Vought top management that 
a need existed to plan for and monitor the inci^asing con^lexity of 
military aircraft* This was accong>lished by a conplete reorganization 
in 1946. 

Process Control apd Fahr|cfl't|ph Ppn^ 1947 - Ana^sis of the 
prime areas of control requiring high technical competency resulted in 
the transfer of Engineering Department functions to Quality Control. As 
a result engineers were transferred from Engineering and hired to 
Quality Control from the outside to^form the Process Control and Fabri- 
cation Control Sections in 1947 • During this period the F6U-1 ^nd F7U-1 
were in their initial stages of fabricatiph.^^^^ ^ 

Quality Electronics I 951 - With the introductipn of the Regtilus I 
Guided Missile it became apparent that a major effort had to be | made to 
assure top quality electronic components and systems for the Regulus I 
program. To accomplish this the Quality Electronics Group was estab- 
lished un the Fabrication Control Section. This group was responsi- 
ble for establishing preventive and corrective action for inspecting, 
calibrating and testing all electronic equipment on Missile and air- 
craft. '■■■' " ■ 

Quality Control Organization '7 

From this evolution of the inspection function through to the 
plant wide concept of Quality CohtH from design consi|Lefa- 

tions through to ciistomer acceptance, the Quality Control functipn 
developed. It consists essentially of two functions; an engineering 
function and an inspection function. The engineering responsibility 
includes working closely with the design engineers, planning n^ pro- 
cesses, and preparing the necessary instructions to monitor th4se pro- 
cesses in the shop in order to prevent problems; and trouble -shpoting 
problems that do occur and JrOrre^^ as necessary.: 
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The Inspection Sections have the prime responsibility of assuring 
that all parts and assemblies accepted meet drawing and specification 
requirements through actual physical inspection and provides the 
necessary policing to see that the control procedures established by 
the Quality Control Engineering Sections are carried out. 

Shop and Airport Inspection Sections - Illustrated is a flow- 
diagram of inspection processing of raw material through to boi^lete 
aircraft check-out and customer acceptance. 

Process Control Section - The Process Control Section plans for 
and monitors all chemical^ metallurgical and bonding processes^ es- 
tablishes necessary statistical quality control procedures on a plant 
vide basis, and controls all outside quality control activities. 

Fabrication Control Section - The Fabrication Control Section 
plans for and monitors aH mechanical processes, final assemblies, 
field operations and electronic operations. 

Qmlity Control Program 

It may be seen from the Quality Control organizational set-up that 
a complete and systematic quality control program for all models has 
been established. Functionally this program starts with the original 
design where Quality Control Engineers with production experience may 
confer with their design colleagues on new models to prevent problems 
that history has indicated may be expected. From this design phase 
throu^ to analysing of customer and service complaints the feed-back 
cycle is completed. 

Quality Control of Manufacturing Areas 

In order to implement this program it is necessary to know where 
the major poor q\aality areas are so that manxifacturing cost can be re- 
duced by reduced scrap rates and production schedules may be met with 
more assurance. As an exan^le of the method used by Quality Control to 
maintain and inqprove the quality of Chance Voxoght products, each Manu- 
facturing area is reviewed for poor quality trends and repetitive dis- 
crepancies and malfunctions -using the latest Statistical Quality Con- 
trol methods. Just as the Process Control and Fabrication Control 
Engineers handle probler^ on the spot to get them corrected, the 
Statistical Quality Control Engineer objectively reviews by major area 
and as necessary specific unit the effectiveness of the detail Manu- 
facturing and Quality Control effort. Throu^ high point reports and 
other detail reports to all levels of management a constant quantitive 
level of quality control performance is maintained which is specific 
enou^ to help the line supervision improve the quality of their work. 
Through the use of statistical control methods which define normal 
variations in quality, deviations from a controlled operation are in- 
vestigated and the elements contributing to poor quality are isolated 
and eliminated. 


Statistical Quality Control Function 

In order to keep the overhead costs down to a minimum and yet per- 
mit plant wide surveillance in sufficient detail to permit corrective 
action, the Statistical Quality Control Group has for the past several 
years been utilizing suad further refining their IBM methods of opera- 
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tion from the detail fabrication stage throu^ to service cougalaints# 
Althoxi^ this chart illtistrates use of IBM i^thods In the Ifeterj^^^ 
view system, it typifies the system used for controlling service, com- 
plaints, vendor troubles. Government IHirnished Equipment troubles, as 
well as all factors involved in the Manufacturing areas* 

Conclusions 

From this presentation it may be noted that the Statistical Quality 
Control function is one element in a balanced Quality Control program. 

It is not considered the most important element, but is aiwngeS 
functionally and organizationaily at a level comparable to othei^ ma^or 
functions in the Quality Control system* It has also been shown that 
an Aircraft Quality Control System is not unlike that of other in- 
dustries when . , It if, , , r#alif ed , witM ^ 

company many job shops perfoimi znany functioii'l^^ monitoring 

using the best available Quality C^ techniques* Therefore, 
whether the Company employs less tlmh 50 peoplle or i^re than 10,CXX), the 
Quality Control concept originates with design considerations t^rqu^ to 
final use of the product by a satisfied custon»r* 
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AUTOMOTIVE DIVISION FIRST REPORT OK 

MACHINE TOOL CAPABILITY STUDIES ;; 

il 

B* C# (Tcicols f iTz* • 

Minneapolis-Mollne Company 

Reduce the risk of wrong decisions and you implement progress. 

Such is the objective of the Task Force on Machine Tool Capabilities, 
as set up in the Automotive Division of the American Society for Quality 
Control. l! 

Over the years, many machines have been a bone of cpntentiO£( be- 
tween vendor and purchaser. When defective material was produced, the 
purchaser was prone to blame the machine; and the vendor to believe his 
machine capable, because he had seen successful sample runs. Such dis- 
agreements, even on a friendly basis, tend to increase the obstacles in 
the way of corrections and ultimate satisf action. 

Decisions on the part of a vendor or purchaser to spend correction 
money should be guided by proper facts. These facts must be reproduci- 
ble and also must be accepted by the affected parties as reflecting a 
true picture. 

As most of you have already discovered, existence of defects 
neither accuses nor absolves the the same token, a Sample 

run without defects does not assure that the machine is satisf ac-ljpry. 
Deviating product may be caused by inherent characteristics of tbe 
machine, by external factors ^ or by both. Unless a process produces 
essentially all deviating product, samples free of deviation are ;poBsi- 
ble, and increasingly probable as the proportion of deviations decreases. 

The Task Force proposes economical, reliable and reproducible meth- 
ods which are tp determine the^ y^^ Inherently associated with 

the machine tool. Comparison of this variability with that allowed by 
specification, will show the amount of leeway for variation external 
(Chart II) to the machine. When this 1^^^^ is adequate, it is |)OBsible 
to run production essentially without defects. Excessive leeway is usu- 
ally uneconomical. Inadequate leeway is usually both troubiesomp and 
uneconomical. 

Establishment pf a sound method tp l*pech pur objective required an 
understanding of several viewpoints. To achieve this understandiiig, the 
Task Force has included the Chief Engineer of two respected machine topi 
companies, the Master Mechanic of an autompbile maniifactu^ a Tool 
Engineer from another, a Statistician, a Chief Industrial EngiheSr, and 
four Quality Control engineers from several automobile companies; In 
addition, several guests were invited to contribute to our enlightenment. 

The pooled experience of these professionals in different aspects 
of the field yielded many interesting and occasionally heated discus- 
sions. Divergent views were explored and usually reconciled. Each of 
us had beside the Task Force objective, an important objective related 
to his own viewpoint. Owe efforts were to make those compromise^ whic^ 
provide a good answer for all of us, with minimum disruption to 'any of 
us. 
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For example^ no tool vendor would want to disappoint his customer 
by needless delay in delivery. Kor would he like to over-build his 
precision to the point he could not compete for business. He would like 
to be sure that unreasonable demands for service would not gain support. 

The pixrchaser would not care to bind himself to acceptance through 
some scheme he did not trust. Production people would hesitate to delay 
delivery for some doubtful quality assurances. 

Master Mechanics could challenge the quality capability when it 
failed to agree with their past experience. Conflicts might seem in- 
evitable. 

A statistician might shy from the approximations in a scheme which 
soundly meets the Task Force objectives. 

From these varied backgrounds has emerged a fuller realization that 
these well guided compromises yield a valuable tool to enhance the 
quality-cost performance decisions. These decisions can be made with 
a much higher batting average through the use of simple economical means 
which have met the general approval of the committee. 

To provide customers with acceptable quality at lowest cost, it is 
necessary to have proper balance in design, tooling, and process con- 
trols. Proper balance is imlikely if the contribution of each factor is 
not known. 

Ctood design will carry specifications which can be met at a cost 
commensia^ate with the intended use. Tboling should be aimed at econom- 
ically meeting such specifications. Operating controls must realize 
good usage of basic process capabilities. 

The foundation for meeting these three requirements is knowledge of 
the basic process capability. Most uneconomical specifications come 
from lack of this knowledge. Failures to meet reasonable specifications 
result from (1) inadequate process capabilities and/or (2) inadequate 
operating controls. Again, only knowledge of the existing process capa- 
bility can diagnose the cause or causes of the failure. 

Inadequate tooling frequently comes from lack of knowledge of its 
capability at the time of its selection. It also frequently comes from 
failure to realize that operation cannot be perfect, but also adds to 
the variation (Chart II) even under the best of control. Stock im- 
properly prepared for the operation, and machine wear are other causes 
of inadequate performance. 

Poor control is often blamed on the machine. Only knowledge of the 
machine capability can show the true cause. 

In short, knowledge of machine capabilities permits engineers to 
select specification tolerances enough wider than basic process spread 
to allow for reasonable control variation and a small amount of wear 
so that economical maintenance procedures may be followed. 

Knowledge of machine capabilities and control allowance require- 
ments avoids the dissatisfactions which result from inability to meet 
specifications, and the excess costs involved in over- tooling. 
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Realizing the important role played hy knov ledge of process capa- 
hility, and the additional allowances neede^^^f^^^^ control and ' 
economical maintenance, the Task Force has endeavored to ^investigate 
the reliability of several niethods used to determine capability, and the 
problems involved in understanding and applying them. ! 

Many of those who have tried to apply perfect sound plans bave 
noticed how ip possible ways of casting doubt op aziy 

interpretation of data T^ed in s a machine or process capability. 

- - 

At this point, it seems proper to eraphasize that the Task Fo^ce if 
not trying to cause society at large to decide something that they do 
not now decide. Rather it is trying to provide that segment of society 
which already decides these things, with optimum procedures to reduce 
the risks inherent in such decisions. It recognizes that absolute 
certainty appears unattainable, and therefore proposes ^ 
nomically feasible techniques to raise pur certajnty of good deci^ons 
to levels mpre acceptable than now typically exist. 

All of the plans discussed are Quality Control techniques based on 
laws of chance.; All have successful histories of practical use by many 
coB^nles. Properly applied and interpreted all wlll 'yield impro^d 
results in laost cases. 

In eachJBethod, the production performance is predicted from samples 
taken under contro lle d conditlor^ . The laws governing the relation 
between fampies and lots are well fpmided' m ^e wdy they 

operate fails well within the experience of most people in the general^ 
mechanical production field. " 

A 3 nEned with fuff ici^^^ sensitive gages, any illusion of identical 

sized pieces coming from a process is dispelled. We usually find a 
central tendency, or similarity of sizes, with some scattering larger 
and smaller. Measineaieuts ta^en on large lots produced under re iatively 
constant conditionf usually have about 2/3 of the pieces in the central 
third of the tptal spread. Small samples seldom contain pieces near both 
limits of the lot spread. The ayafage of sizes in individual sagples 
ustially resembles the average of sizes in the Ipt, oore closely in large 
samples than in small ones* Likewise, the spread observed in lalg 
samples more closely resenbies the spread of the Ipt tban is the case in 
smaller samples. 

Statistical ffiathematics have provided us with simple ways of relat- 
ing the conditions observed in samples to the facts parent lot, 

or production. They also give us measures of the reliability with which 
we can describe the parent lot from the information in our sample. 

The reliability of our interpretations slowly increases as jiample 
data increases. Datf qn^ become more reliable as the squa 

of the san^ie size. Spread data (by methods which look at all tj(ie 
saa 5 >led pieces) become more reliable as the square root of twice the 
sample size. Where we judge spread only by the spread between tjbe 
largest and smallest pieces in our sample, we do not make much gain 
after the first few pieces in sample size, and actually are ie 8 s| ef- 
ficient in large sized samples. 
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The last paragraph briefly states some statistical facts* The 
logic of these facts Is apparent from many commonly accepted statements 
such as "first impressions often fool you", "don’t put all your eggs in 
one basket", "experience is the best teacher", etc. The first says, in 
effect, further sampling will be more reliable. The second infers that 
losses in one case will be offset by gains in another. The third urges 
to learn more reliably by being influenced by more events, i.e* larger 
samples. Gambling odds and life insurance premiums axe based on ex- 
tremely large eamplee which are so reliable, that going broke in either 
business where the capital is large enough to survive the adverse sample 
is practically unknown. 

The average, or high turnover stock in shoe sizes is well known by 
the experienced shoe merchant, as is the usiial range of sizes desirable 
to stock. Judging by your own shoe size and the shoe sizes of those few 
friends whose show size you know, however, you would be unreliably 
equipped to stock a shoe store properly. Again, for reliability, sample 
sizes must be adequate for the intended use. 

The statement concerning the efficiency of spread determination by 
size difference between the largest and smallest items in a sample re- 
fers to the comparative ability of ranges and standard deviation calc- 
ulations in discerning variability in a lot from the data of a sample. 
Standard deviation calculations consider all the pieces in the sample, 
whereas range ignores all but the largest and smallest* Obviously in a 
two piece sample they are equally efficient. As sanple size increases, 
we obviously ignore more information in using only the range, and we may 
rightfully suspect those ignored pieces of the sample are capable of 
adding to our knowledge of the lot if we know how and are willing to 
consider them. 

The distribution of sizes in large random samples closely resembles 
the distribution in the parent lot. 

To judge machine performance from samples our goal should be ade- 
quate reliability at least cost. Obviously, lack of pieces or man hours 
may force us to a lower reliability. However, failure to use the in- 
formation from any piece measured is wasteful of measurement effort. For 
this reason, use of range in any but small sacples is NOT recommended as 
a guide to capability. For larger samples either use of the average of 
the ranges in small sub- samples, or the use of probability paper may be 
recommended. Both methods are simple to use. Each has special ad- 
vantages • 

Use of the average range in small sub- sauries where the pieces in 
each sub- sample gire taken consecutively, and without process disturbance, 
gives high reliability in determining the basic machine capability for 
most operations, provided a large enough total sample is used* Where 
larger total samples are involved, the use of histograms, or better yet, 
probability paper adds an excellent picture of the distribution of sizes. 

The Task Force recommends the use of the Shewart Control Chart for 
Averages and Ranges (also known as X and H charts) as the most broadly 
applicable basis for determination of machine capability. The total 
sample size normally should be not less than fifty (50) pieces, with 
saapies up to two-hundred (200) pieces, being desirable where practically 
and economically feasible* The samples should be grouped in five (5) 
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piece sub- groiqps preferably run cot»ecutively, but in any event jrua wiib- 
out process shift or disturbance in any sub-group. 

To avoid waste, a capability run should te terminated if the dif- 
ference in dimension between any two of the first five pieces exbeeds 
82 ^ of the tolerance allotted to the machine or process, as this is 
virtual proof of excess variability. This is true since a range 82 ?t as 
large as the tolerance predicts a process which uses at least all 
tolerance, allowing nothing (or less) for any external factors. In fact 
a range over 6l^t of tolerance would be expected to fail the requirement 
of permitting 25 lt for external influences. 

When a process qualifies under the above criterion, the ten (10) or 
more sub- samples are to be appraised against control limits. OuLt of 
control points usually should not contribute to the data used in apprais- 
ing the proceis. If any substantial number of the points are ouV pf 
statistical control, the following decisions appear proper* If the out- 
of control points are average points, the causes are satisfactorily ex- 
plained, the dimension is operator, rather than process controllable, 
and the range data is in control, the process m judged from 

the test. Only if the range data is generally in control, is the test 
safely interpretable, if the average data applies to process inbuilt 
functions, it also must be generally in control to be safely usable. 

The useful data is to be interpreted by the standard method'^ where 
inherent process variability or spread is equal to six times the average 
of the sub-sample ranges, divided by d 2 , which for five apiece 

series, or 2.579 timefS the average range. In most cases the process 
inherently will be capable of holdi^ a set average plus or minus half 
the spread. This is tj^ically s^^ judgment since most obser- 

vations in machine processing are reasonably similar to the mathematical 
normal distribution. A few types of observation such as off-sqtmlfe, out- 
of« round, etc. are skewed and may be decehtered, so that they mi^t be 
average value minus a third and plus two- thirds the spread, or some other 
such value. 

If the total data is in control, or most Of it is, and those point 
out of control are discarded, a histogram, or better y^ plot of -^e 
data on probability paper will reveal whethef the assumption of symmetry 
and/or normality is safe* 

When the process or machine inherent spread has been determined, 
cosparison of this spread to the part print tolerance may be made. A 
generally accepted view holds that the ihhereht spread should no*! exceed 
75lt of the part print tolerance. In especially critical cases il might 
be desirable to allow it^ of the specified toleranc^* In 

no case may it equal or exceed the specified spread, since tool wear, 
tool setting and other such unavoidable disturbahces will always increase 
the operating spread beyond the inherent spread. (Chart II). 

Where a dimension is inherently machine or process fixed, as a dis- 
tance between two holes simultaneoiisly bored by a pair of fixed spindles, 
the average determined by the test, plus and minus half the spre^ calcu- 
lated from the range data must fall within specified location t6|erance, 
preferably with some margin for maintenance. 


These recommendations reflect careful SOpsideration for^simblic 
and dependability, factors typically in conflict. The use of rafees 
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instead of the longer more rigorous mathematics only slightly increases 
the possible error in an estimate of the process performance, but great- 
ly simplifies obtaining a reliable estimate. 

When ve speak of reliability, ve mean assurance that our opinion of 
capability is stiff iciently exact, in the vast majority of cases* This 
may sound like hedging. We want to be "exactly exact" and "every time". 
Unfortunately we know of no human being who knows a means of fulfilling 
this want. We can, however, compare the reliability of our proposal 
under some varying conditions. For instance, most test values will have 
been calculated from a, sample which had more than typical variation or 
less than typical variation. 

In small samples, extreme dimensional values of individual pieces 
will distort our opinion of the lot or production more than such values 
would if counter balanced by a larger number of typical pieces. The 
sample calculated value of an individual sample might occasionally give 
a very distorted picture of the expected performance. Tet if we are 
willing to be right 90 ^ of the time, we can state that for a given size 
of sample, the lot will have variation within or — - fixed percent- 
ages of the sample indicated variation. If we want to be right of 
the time, the or valiies are larger, but equally definite. For 
lOO^t of the time no one can provide a definite limiting error in opinion. 

The band of predictable difference from sample derived variation 
widens very rapidly as total sample goes below 25* It narrows quite 
slowly as total sample size increases over ^ pieces. What does this 
mean to us? First, it means that samples less than 2^ should be used 
only when no other alternative seems practicable, and then one must 
realize that his opinions contain much doubt. Second, the requirement 
of sanqples over ^ pieces should only apply where larger samples Involve 
reasonable costs. 

Chart I shows the limits of variation from sample estimated spread 
to be expected in a lot with sample sizes from 2 to 100 pieces when \ising 
range in sub- samples as a basis. Although the choice of ranges differs 
slightly from those recommended by the Task Force, the values plotted cure 
similar enoxigh to Justify use of this chart for guidance purposes. 

Only slightly increased reliability is available from any other 
system, and that is achieved with far greater conplexity and effort. 
Assurance that the sample properly represents the lot is better than 
with most other methods, ^tethods which are even slightly simpler than 
the proposal suffer substantial loss of reliability. 

The objective of the Task Force, namely, reduction in the risk of 
wrCng decisions, through economical, reproducible and dependable methods 
of appraising the variability inherently associated with the machine too\ 
appears to be met by the proposed system. 

The system is summarized as follows: 

1. A total sample of 50 to 200 pieces depending on economic factor 
is recommended. These should be so run that no basic disturbance 
enters the run of any single 5 piece sub- sample. 
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2. When the dinenslon^l dif ferehe® 2 of the fii^st 5 

pieces exceeds 82^t of the specified tpierance the test |houid 
be stopped as this is virtual proof of excess variabiliiy. 

3. If condition 2 is met, plot for eech 5 piece sub- sample the 
range, which is the dipeiwipi^l difference between the^^^^ 
and smallest observation In that sub-sainpie. 

4. Plot for each 5 piece sub- sample the average (X) of the sizes 
in the sub- sample. This is simply computed by adding the 5 
dimensions, and multiplying the sum by 0,2 (i.e. double and 
move the decimal one place left), 

5. Conpute the average range (R) by adding the sub- sample ranges 
(R) and dividing the sum by the number of sub-setnple ranges 
used, 

6 . Multiply R from 5 by 2.11 for an upper control limit on;;|V|nges, 
and compare each individual sub- sample R to this limit*:' If all 
are below this limit the range data R are all acceptable* If 
any are over the iimlt, those sub- samples should not be tised. 

If the over control ranges are a very minor proportion of the 
observed sub- samples, or if the cause of disturbance of the 
over control ranges is known and known to be external tp the 
machine, proceed as follows ; 

(a) Recompute R y (meaning the R for use in stfp 7) as 
in step 5 except do not include any data from over- 
control sub- samples, 

(b) Repeat step 6 using the revised R7 of 6 (a), 

7* Using the correct R, (from step 5 or 6 (a) as applicable) multi- 
ply by 0,^ for^Ag.' Compute grand average dimension X which is 
the sum of the X*s of step 4 divided by the nunfeer of shb-saapOtes 
observed. Check to see if each X lies between X or— ^2^, 
If all dp, all average data are acceptable. If the out'^pf con- 
trol averages are a very minor proportion of the observed sanples, 
or if the cctuse of the disturbance is known, and known to be ex- 
ternal to the machine, or operator adjustable in the machihe, 
the data are acceptable. If the basic dimension is no t operator 
adjustable, or a distinct exact external cause is not kpown, no 
safe conclusion may be drawn. 

8. When the above steps q\ialify the sample as representative of the 
performance of the machine, the followingcapabilityde^r- 
mination is made, 

(a) Por operator adjustable dimensions, the Rj 
multiplied by 2.579 is full inherent process 
spread and may be compared to specified 
tolerance spread to allow for variations 
outside the machine. Process knowledge 
would indicate that in some cases, it shoujld 
be substantially less than 75^ of specified 
tolerance spread, as in certain grinding 
operations where wheel wear would otherwise 
require excessive attention to setting. ' 
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(b) For machines which are not operator adjust- 
able for the observed dimension, the macjaine 
capability is Judged to^have the limits of 
step 7 -jA* or 1.29 Rj. These limits may 
be compared to specified limits. It is re- 
commended that some margin be allowed for 
error and external factors. Where 2-sided 
limits apply a similar basis to step 8 (b) 
would show that or — - 1.6 should 

fall inside the specified tolerance. Where 
the tolerance is one sided, such as only a 
maximum or only a minimum specified, it^wlll 
be safer to compare Xy or — 1.29 5^ (as 
the case may require) with 75?^ of the specified 
maximum or 133?( of a minimum. 
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QUALITY HIOBLEME OF AUTOMOTIVE FABRICS 
FROM THE mCDUCER*S POINT OF VIEW ,, 

Everett C* Atvell 
Burlington Industries, Inc* 

No inaniifacturer, can expect to survive in today *s intensely -cou^eti- 
tive ximrket withcnt a healthy respect for a strong quality control pro- 
gram. The mainteriance of full control of ^r materials entering; a pro- 
cess and at each step during processing is necessary to ass^e dompriahce 
with end use specifications and to keep at a low lev^ seconds, unmer- 
chantable goods, rehandling and lost productive time. 

The first step in insuring satisfactory quality in a given Automo- 
tive fabric must start with the fabric cpnstriictipn itself^ A c:qi^ 
tion of fibers and yarns must be chosen to provide aesthetic appeal and 
a minimum of production quality problems. It is here that the atpry of 
quality control begins. In the initial design of a fabric, a base fiber 
is chosen which will provide the strength and stretch to withstand 
repeated loading without early fatigue, A second, or a second and third 
fiber is selected usually to form the face of the fabric w^^ch combines 
strength, stretch, and abrasion resistance and with dyeing properties 
which lend themselves to unique color combinations with the other fiber. 
The fibers that are selected must be characterized by good spinning per- 
formance in the case of staple fiber and provide satisfactory ydrn 
appearance and dye levelness in the finished fabric. Quality control is 
exercized all the way from checking the uniformity of the stapl^ fiber 
stock going into work to the finished yarn. These tests include checks 
on weight, uniformity of weight, twist and breaking strength, tilament 
yarns received by yarn producers are, by experience, so well coiitr piled 
for quality in production that a weaver seldom fir^s it necessairy io con- 
duct more than random tests on incoming shipments. Weaving operations 
must be fully controlled and every precaution taken to prevent visual and 
latent defects. This is especially true in preparatory work oh; filament 
nylon where uneven t®ns^ons or other process irregularities can:! cause 
unsightly streaks. Finally, after the first production of greige fabric 
is woven, each roll is given 100% inspection and graded as stanj^ard or 
' substandard. At this point, all conditions which have been . contri-. 
butors to the production of substandard fabric which pannpt .be :hhipped to 
the customer are immediately followed back with the appropriate' produc- 
tion section for follow-up and correction. In many instances the capise 
or origin of the type of defect observed is obvious while in otheTs a 
fairly comprehensive group of tests must be made in the Laboratory to 
ascertain the source of the trouble - fpllowihg which remedial ^'steps can 
be taken, " ff ' ' 

■■■ 1 ' ■ 

Automotive production imits, as in a majority of other types of 
manufacturing, set up once each year to produce a limited ntamber of kinds 
of items. Sroduction usually runs on these items for a fiill year wlthbut 
more than a few corrective changes in design or standards. In Contrast, 
the successful tepctile production unit today is faced with setting up for 
short runs on a multiplicity of styles which puts pressure on the quality 
control group to detect defects and apply corrective action with the 
utmost speed, otherwise, it is possible to get into a situation: of giving 
late deliveries and building up an inventory of substandard fahjrics with 
no outlet other than at prices under cost. Thus you can see that the 
observation and fast correction of defects resulting in inferior quality 
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is the key to a high standard of qijality not only in greige goods but 
also in finished goods deliveries to customers. In fact, the rapidity 
with which these corrective steps are taken is frequently the key to 
whether a supplier can do a satisfactory production job or not. 

All large maniafacturers have at least two sources of supply for each 
item purchased. This means that for each new style accepted by an auto- 
motive customer at least one other supplier must also satisfactorily and 
quickly d\:qplicate the style. This involves analysis of the competitors 
sanple, design, the preparation of greige goods, finishing of the sample 
piece and submission to the customer. This conplete waste of time, added 
escpense and effort on the part of the suppliers has been recently resolv- 
ed by the free interchange of construction details between successful 
bidders to the automotive trade. 

Whereas in the production of automotive greige goods, greater enp>ha- 
sis is placed on inspection techniques and mechanical controls, greater 
en5)hasis in the dyeing and finishing operation is given to chemical con- 
trols, These consist of checks on detergents used in the boil off, dyes, 
wetting agents and dyestuff fixatives used in the dye bath, and function- 
al finishes such as water repellents, resinous face finishes and back 
sizing used in the finishing operation. Additionally, the application of 
the materials selected for use are subject to control. This includes 
time, temperature and concentration of detergents in the boil off tank, 
time,te3iqDerature and quantities of dye and auxilliaries in the dye bath, 
total solids in the back sizing and temperatures and width in drying. 

The final quality of the fabric prior to shipment to automotive 
accounts is determined first by 100% visual inspection and classification 
and secondly by adequate sanpling of the rolls for subjection to end use 
tests. It is not until inspection, classification and end use tests have 
been conpleted that a lot can be considered for shipment, 

I think we would all agree that the major aim of suppliers to the 
automotive trade is to deliver goods that meet the purchasers require- 
ments. One problem which confronts us is the dissimilarity of perfor- 
mance requirements in these fabrics, all of which are going into the same 
basic end use and hence should have the same requirements. In the field 
of fabric inspection, which is one phase of the quality control picture, 
there is no particular problem inasmuch as here we are concerned with 
defects which are readily apparent to the eye and, while our judgment may 
vary to some degree, requirements are essentially similar so that there 
is no great difference of opinion. However, in the case of end use test- 
ing, the automotive specifications which the sT:5)pliers are required to 
meet differ not only in terms of the test method but frequently where the 
test method is similar, the evaluation is so different as to make the 
level of acceptability quite different. For an example, I might mention 
the matter of testing a fabric for resistance to sunlight exposure. In 
this particular case the supplier to Company ^*A" is required to meet a 
90 hour exposure to Florida sunlight while Conpany requires that the 
fabric pass a 50 hour exposure in the Fadeometer and Company ”C” requires 
the fabric to pass a 90 hour exposure in a Weatherometer, The results of 
testing a fabric by one procedure differs from the results obtained by 
the others. This simply means that. a fabric that is acceptable to one 
customer for a specific end use may be wholly unacceptable to one or both 
of the second and third customers for the same end use. Then there is 
the situation where there is no acceptable test method available to 
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evaluate a f^abrio for some particular service or function which it must 
perform or to meet a qpndition,tp which it ^ i,; . 

Here again the si^plier is obliged to test deliveries to eaph custo- 
mer by the customers* methods which are usually quite different and again 
the same goods may be acceptable by one method and unacceptable :by the 
others. While there is no intentipn of being unduly critical of the in- 
dividual tests themselves, we do feel that unanimity of such procedures 
i«^uld be to the best interest of all concerned. Suppliers would then 
have a single condition to meet which would put them on much firmer 
ground when fabrics are made on a sample basis and it is not knqwn at 
that time to which customer the siibmission is to be made, 

I have no desire to labor the point but the same discrepancy in 
requirements exists in many other areas in the specifications and we feel 
that a great deal could be accomplished in achieving better quality deli- 
veries through standardization of testing procedures and evaluation on 
automotive fabrics. The very obvious thought will probably occur to mar^ 
as to why do not the suppliers shoot for the very maximum in en^ use per- 
formance and thereby avoid any field of controversy by establistilng our 
own standards so high as to encompass all. The answer is equally obvious 
to those of us who have had experience in trying to meet the requirements 
of this trade. It is siii5)ly the age old problem of not being aiile to 
improve one characteristic without forcing some other feature tp suffer 
thereby. As light fastness is improved to a desirable level quite fre- 
quently trouble will be encountered with leaching or a transfer:- of color 
within the fabric on wetting. When proper chemicals are used tp correct 
this deficiency, the light fastness may be affected considerably and so 
it goes. 

The quality problems of the sort mentioned above are fairly common 
to all the automotive suppliers. In certain instances requirements which 
we may feel are undtily high and by the same token extremely difjticult to 
meet, could make for considerably better overall performance if the level 
required in the aforementioned instances were reduced. In an effort to 
atten^t to focus attention on certain constructive action which: should 
iji5)rove the overall quality of goods supplied by the various processing 
firms to the automotive trade , an Automotive Upholstery Fabric si' Associa- 
tion has been formed. This association consists of representatives from 
each of the major automotive fabric suppliers and its prime purpose is to 
Consult on mutual problems, come to agreement on a course of abtion which 
would be mutually acceptable and practical and present both the' problem 
and recommendation to the various automotive concerns for their ^ consider- 
ation. We believe that this will be a very constructive step these 
recommendations are given serious consideration and free discussion. 

Another approach to the problem of developing test procedures to 
determine characteristics or performance under conditions for which 
standard procedtares are not now existant involves consideration of pre- 
senting such problems to either American Society for Testing Materials or 
the American Association of Textile Chemists and Colorists, These organ- 
izations are comprised of technologists from all segments of the textile 
industry. Task committees are formed for each special problem ’coirprising 
specialists in the fields covered by the problem at hand. These commit- 
tees formulate most of the standard procediares used to characterize 
behavior of textile materials under various conditions of use, ; Proce- 
dures formulated by the AATCC do not become standard procedures for 
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industry use xintil the procedure has been in use in a "tentative” status 
for at least one year and then only by a majority vote first by the- 
Technical Committee on Research and then by the Executive Committee on 
Research, Essentially similar safeguards are practiced by the ASTM, It 
is to be especially noted, however, that these are strictly test methods 
as it is not a function of either of these organizations to suggest, pro- 
mote or establish minimum or acceptable quality levels. The adoption of 
this approach to the formulation of new test methods would provide a 
unity of purpose and procedures acceptable to all concerned without 
removing the prerogative of the automotive conpanies to establish their 
individual levels of quality acceptance. 

Where large numbers of like units are being produced, statistical 
methods of control can be employed with considerable savings, but even 
more important, better assurance of uniform quality. Where these condi- 
tions are not met and we have multiple small quantities of many dissimi- 
lar units in production, statistical methods are inpractical if not 
impossible to apply in pur experience to date. Statistical methods are 
more readily adaptable to the control of laps, roving and finished yarn 
production but are increasingly difficult to apply at points beyond the 
finished yarn stage. For example, application of the method can be 
applied to tension controls ari to establishing causes for yarn breaks 
in the preparatory area and to the evaluation of major and minor causes 
for visual defects. In some instances it can be applied to fabric 
inspection, however, this has not as yet been adapted to automotive 
fabrics primarily because we are. not only interested in determining 
average level of quality for control purposes but it is of major impor- 
tance that individual pieces be properly classified to prevent shipment 
of substandard goods to our customers. 

In summation, it should by now be apparent that the quality control 
of production of automotive fabrics is a very challenging field by reason 
of the high requirements of qmlity and performance which are much more 
difficult to attain than for the majority of the end use requirements in 
other fields. Great strides have been made over the past ten years by 
way of more appealing styling, greater fimctional performance and greater 
durability. We, the textile sii^pliers to the automotive industry look 
forward with optimism to our ability to keep abreast of both technologi- 
cal advances and changes in customer requirements in maintaining a high 
standard of quality in this field. 
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QUALIT? COWPROL TRAINING COURSES 
PART ONE 
IN-PLANT COURSES 


■ 



Joseph Novshin 

Thoinps on Products, Incorporated 
and 

Rudolph Freedman 
Alco Valve Company- 

In discussing In-Plant Training Courses in statistical qualfty con- 
trol, we must consider the background of the individual w are going to 
train, his place in the organization, the use to which he will put 
statis Ileal quality control, and his interests* These factors in|y be 
viewed in connection with three of the catagories of people within an 
industrial organization. 


A# Production Supervision 
B* Practicing Quality Control Technioihhs 
C. Design Engineers 

Vhen we refer to production supervision, we usually have in mind a 
^foreman”. This man is usual!^ charged with getting production but and 
in order to do so, it often becomes necessary for him to train ^pricers 
and to work with other staff departments in the application of i^any of 
the indtistrial techniques that now associate themselyes with 
Re has no natural interest in statistical quality control and to him it 
is just another industrial tool. Indeed, his interest must be ajrpused 
in order to take statistical quality control out of the fad sta^e and 
into the truly useful tool stage. 

Before the method of training is discussed, we must decide^;the pur- 
pose of that training. Do we want to make a Quality Contrbl Engineer 
or do we want to teach the man enough about quality conirol that he will 
merely be acquainted with it? In view of the duties that a Production 
Supervisor already has, I do not think that we want to make a f^ll 
fledged Quality Control Engineer. Also, his background does not readily 
lend itself to him fully in the techniques of statistical 

quality control. However, I think that we want n^re than merel^ to 
acquaint him with the subject. It is important that a Production Super- 
visca:' knows enough about quality control that he will know its |imi- 
tations as well as what can be accoiiiplished by its use. He shopld learn 
enough to work intelligently with th^^ Control Depariment. 

The actual training should start with a sales program to arouse 
Interfst in statistical quality control. After interest is aroiised, the 
sales program must continue until the supervisor is convinced ojf the use- 
fulness of the technique, means that the entire training is, to a 

large extent, a seiling plan. A good start should take the fora of 
individual talks between the Quality Control Engineer and the super^sor. 
Reference might be made to how statistical quality control workisd in 
other compares and how these other companies have profitted frpm the 
program. It should then be poi® the program can help not 

only the company but also the supervisor's department and the supervisor 
himself . A display of interest-arpuelng gadgets, that demonstrate 
statistical quality contrbl principles, is helpful* Allowing the super- 
visor to use these gadgets and to show them to some of the people who 
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vork for him will often make him want to learn more* Ihere are a num- 
ber of such items available* 

After his interest is aroused^ he shcmld be given a course in basic 
statistical quality control* In order that there might be adequate 
group discussion^ not less than foin* should take the course at one time* 
If the instructor is to give each the proper attention^ there should not 
be more than fifteen in the group* 

There are certain features that the course should have. 

1* It must be simple* It must be given in terms that are 
easily understood* The mathematics should be kept at the 
absolute minimum* The use of shortcuts such as tables 
and calculators should be encouraged* 

2* It must be basic* Only such things as frequency distri- 
butions, control charts, and acceptance sampling by 
attributes should be covered* No special techniques 
should be introduced. If there is a need for these tech- 
niques, they may be introduced at a later time* 

3. It should be built around the principle that they learn 
by doing* Emphasis should be placed on allowing everyone 
in the course to take an active part. This may be 
accomplished by the use of work sheets, which should be 
completed in the classroom. Whenever possible, the data 
for these work sheets should be obtained ty measuring a 
characteristic on actual parts being used or manufactured 
by the company* One of the characteristics of these 
parts may be measured by the group itself* A frequency 
distribution, based upon these measurements, usually will 
bring about a full amount of discussion about the nature 
and causes of variation* Work sheets should be of the 
type where proper blank spaces are provided for the data 
and the results* The instructor should make sure that 
each one is working the problem correctly* The results 
obtained shotiLd then be analized with the instructor act- 
ing more as a discussion leader than as a lecturer* It 
should be shown how the principles learned In connection 
with the work sheet apply in industry* 

U* There should be very little or no homework* Most of the 
work should be done in class* If homework assignments 
are given, and the supervisor gets stumped at how to work 
out the problem, he is liable to spend hours arriving at a 
solution, and might very well end up feeling ft^ustrated* 

He will then btiild up a defense against statistical 
quality control* Therefore, homework assignments should 
be very simple* Far better than a homework assignment, is 
for the Quality Control Engineer and the supervisor to 
obtain data and anallze the data together. The results 
can then be presented to the class for discussion. 

Such a course win take about six or eight sessions of about one 
and one-half hours each* However, it is important that the instructor 
does not have the feeling or attitude that certain subjects must be 
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coywed wilfeln a cowproinise with the 

anount of material covered than to liava acme m^bers of the clase fail 
to get full understanding of that which Is them. 

In the case of Quality Control Technicians > we are referrin| to 
those people who carry out the details and the ^ 1 ^ work of the jpSograins 
that are ^t up by Quality Control Engineers* Some of their typical 
duties might be to collect data^ tabulate that data 5 make control 
charts, advise others of routine findings frcmi conbrol charts, select a 
sampling plan for specified conditions, etc. Very frequently thpy are 
members of a union bargaini^ unit and they might have held various pro- 
duction jobs in the past. : 

Ihe training of these people, at first thought, should really be 
quite simple, as it should be a case of self-interest. In other words, 
we might assume that indoctrination would hot be necessary as the man 
who is going to use quail ty control would realize that it is in 
self-interest to be trained in i^e methods. Generally, this is jtrue. 
However, all too frequently we encounter individuals who will gripe and 
grumble about anything new that is taught to them even thou^ 
serve their best Interests to learn and apply these principles. Some- 
how or other, these individuals must be reached before they are turned 
loose in the Production departments or their griping and grumbling will 
erase any of the good work that is being done by the other Quality Con- 
trol fecHM^ convinced l^a^^ in their bejst 

interests to learn and dp a good job of application. 

If we assume that we h^ convinced all of the people 

involved or that we have had in the first place a receptive groiip, we 
will atm have a great problem with di^rse backgrounds. Some will 
have the education, the background, and the experience that will enable 
them to learn very quickly and easily. Whereas, others will be Very 
slow in grasping what is being taught. Therefore, we have the 4>go old 
problem that confronts every educator, namely, to go fast enough in the 
course to keep the better ones interested but stiU to go slowly enough 
so as not to lose a number of the students. Fortunately, in atgf in- 
plant course, we have the advantage of being able to stay in contact 
with the students ell during the working week. Therefcre, tutoring of 
the slower people is not at all difficxilt or out of order. 

The course itself will depend upon the need and the application 
that the company has in mind. In some cases, simple applications of 
frequency distributions, control charts, ant! acceptance sampling by 
attributes is sufficient, Althou^ the course is elementary, it is 
jjnportant that it be thorpugh. S^pathetic understanding is sufficient 
in the case of production supervision but not so with quality cbntrol 
technicians. They must be taught in great detail as this is tl^ grotqp 
that will form the link with other departments. In some cases. It will 
be desirable to teach special techniques and go into the hackgrbund 
information that goes with the fuller knowledge of quality control. 

It is desirable encourage attendance :at 
A. S.Q.C. local section meetings, and Regional Conferences. Thej moS't^ 
outstanding people in this group, depending upon their position: within 
the company and their grasp of the subject, might even be sent jq 
courses that are offered 1:y some of the A. S.Q.C* sections and some of 
the universities* 
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When we consider the In«Planb Training of Engineers, we are think- 
ing particularly of Product Design Engineers and Rrocess Design Engi- 
neers. The educational background of these people is usually adeqiiate 
for easy learning of the basic elements of statistical quality control. 
Even many of the special techniques are absorbed without too much diffi- 
culty* However, there are often several forces operating to limit 
interest in their application of statistical quality control. Very 
often they are under pressure to make a prototype and then get produc- 
tion going. They are not allowed enough time to gather data for even 
the smallest of samples to which statistical analysis may be applied* 

Some large companies have set up quality control sections and pro- 
grams within the en^neering departments and this serves to fj*ee the 
other engineers from testing programs as soon as possible. This section 
may also be used to set up methods for production quality control. 

The training program for engineers may be very informal* A few 
group discussions will help to stimulate interest. Information on the 
actual techniques may be transmitted by making available a few well 
chosen articles and books* A few joint anplications of the adminis- 
trator of the training program and the engineer will serve to get the 
latter started. 
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QUALITY COWTROL TRAINIK) COURSES 

PART TWO ■ ■ 

ASQC SECTION COURSES 

Joseph Movshin 
Thompson Products, Inc. 
and 

Rudolph Freedman 
Alep Valve Ppiapany 

■ ■ ■ ■ 

Since the very beginning of the ASQC, local sections and special* 
ized groups of the Society have conduct^ training courses in Statisti- 
cal Quality Control. In the 195$^56 season, some forty section^ of the 
Society offered si 3 cty-two different courses. While exact figur|s are 
not available at this moment it is estimated .that at least fifty sec- 
tions will have given about one hundred courses in the 1956-^7 season. 

In general, these courses have three basic purposes t ^ 

1) To offer general introductory material on 
Statistical Quality Control. (Sources of such 
information are not generally available and in 
many instances ASQC courses are the only effec- 
tive way of introducing Statistical Quality 
Control to local industry). 

2) To provide a means of improving the technical 
competency of members of the Society and others 
in the field pf Statistical Quality Control. 

3) To provide a means of contacting people who 

might be prospective menders of , the ipeietv* 

This is accomplished through the attending 
publicity as well as throu^ participation 
in the courses thems elves. 

Often a course if dfjigned to accomplish to some degree all three of 
the purposes stated* 

As mi^t be expected, the material presented has been spm^hat 
dictated by the objectives of ASQC Training Courses. In general, they 
tend to be the ^How you do itl** and •*How good is it for youj** siort of 
thing without too much emphasis op the technical fundamentals 9 ^r sta- 
tistical me thcdsipyplyed. In ma instances, *»selling** is an iii?>ortant 
part of the program. Of course, there are certain specialized courses 
which attempt to provide sound fundamental statistical training. Gener- 
ally, however, these, are. ,4n...npecialized ..Helds,'. and.,' art... j,pnsf|e|ed.^^^^^ 
•*adyancsd»* or **special** , courses offered to^ select groups. 

The underlying purposes behind the ASQC Section Courses have 
resulted in certain characteristic. attendance. In general, the classes 
will be quite heterogeneous and cover a broad cross section ofHodus- 
trial and educatippai backgroui^ A single group wili often jiave some 
operating shop personnel with perhaps highschool background. These vill 
be interested pply in acquiring some understanding of what SQC is all 
about. Inspection apd quality control personnel of similar adMatlopal^ 
background will be interested in the mechanism of making and using con- 
trol charts and sampling plans. There will jbe engineering graduates 
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who want to know something about this technique^ and will also want to 
understand more about why it works* Administrative and executive per- 
sonnel will be interested in what quality control can do for their 
Company, and how one goes about getting these benefits* 

This, then, is a broad picture of the ASQC Section Training Course* 
The detail of course content will not be considered as such in this 
paper* We will merely discuss the organizational and administrative 
aspects of an ASQC Section Training Course* The material is presented 
in outline form to attempt to hi^ light the points to be considered* 

The information given is based on an analysis of courses offered by all 
the sections of the ASQC as reported to the Education and Training 
Committee ft*om 195? through the Spring of 19? 7. It includes ten years 
experience of the authors as organizers and teachers of courses with 
the St. Louis Section, ASQC, and Washington University in St. Louis* 
Administrative problems were also clearly pointed up to the authors; 
both of whom are past Presidents of the St. Louts Section, ASQC. 

1) Course Selection 

In the past, the course selection has often been Just 
another matter for the local Education Committee or Bbcecutive 
Committee to decide* Long-range programming was generally not 
considered* It became habit to repeat successful courses on an 
annual or semi-armual basis and to discontinue courses that proved 
relatively unpopular* Recently, however, programming for a longer 
period of time has been adopted by several sections. Specifically, 
a series of courses are developed and outlined* These are then 
offered sequentially so that an individual can take a basic or 
introductory course and, can then take other courses to develop his 
skill or background* An example of such a series is that recently 
developed by the St, Louis Section* This includes the following 
five courses t 

A) Introductory Statistical Quality Control 

B) Intermediate Statistical (^ality Control 

C) Sampling 

D) Pre-Advanced Statistical Quality Control 

E) Special Techniques 

The first of these is purely introductory. The second describes 
the basic control charts in slightly more detail with some of the 
statistical theory involved* The third discusses attribute and 
variable sampling plans and some of the probability theory under- 
lj»’ing standard sampling tables. The fourth develops distribution 
theory and basic statistics to the point where it can be applied 
to certain specific techniques such as analysis of variance, corre- 
lation, or design of experiments. The Special Techniques course is 
more of a you d6 itl** sort of thing with some theory on what 
are sometimes called »*advanced techniques*^ These include: analysis 
of variance, correlation, chi square, design of experiments, special-* 
ized control charts, and similar topics, . The Special Techniques 
course can be altered from year to year depending on popular interest 
and demand. Each of these is presented in ten sessions of one and a 
half hours. At least two courses in the series are given each year 
— one in the Spring and one in the fall* If the demand warrants, 
two may be given concurrently for a total of four a year. 
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A) Subject Matter 

liftiile the subject matter for ASQG Section Coursels could 
theoretically vary widely^ it has become someidiat standardized 
in the past few years. About 75 % of the courses given ard basic 
or introductory in nature. The remaining 25 % are about equally 
divided between courses called «IntermediaM^^M^^ Specialized®, 
and ^Advanced®, The so*^called ®Interra^iate® and ^Advanced® 
vary greatly; the words haying meaning only with respect to the 
level of activity in the particular section and the general 
state of the art in the area. 

Several sections have coniucted surw of their member- 
ship and of industry in their areas to deter^ne what coqjrses or 
subjects might be of interest. Information from such sui*yeys 
can prove very helpful. Such surveys are recommended to all 
sections to periodically determine th® changing interest of the 
community. The questionnaire should consider both acaden^ic SQC 
areas as well as so-called ®How you do itl® subjects, St^ris- 
ingly enough, surveys the writer has seen favgr t-he 

academic rather than specific ®How I make an individual pontrol 
chartl® sort of thing, 

B) Number of Hours 

Courses offered by ASQC sections vary from 1/2 hour in 
length to 3 hours in length. The great majority of courses are 
1 1/2 to 2 hours in length per session. It is the writers* 
experience that after 2 hours and possibly after 1 1/2 hours, 
the mind can no longer endure the “suffering of the seat®;. Once 
this point is reached, the mental absorption of external :matter 
is reduced to the vanishing point. 

The total number of hpws per course varies greatly 
from under ten upirards to sixty. There is no predominant favor'** 
ite although the modal value is between fifteen^^a hours. 

Ten sessions of about 11/2 hou is a popular average for the 
introductory course, 

■ ■ ii ■ 

C) When and Where Given 

In general, there is no clear preference in thii|. About 
one-half of the CQurses are given at a college or other educa- 
tional institutiqn. The other half are given at a hotel or other 
public meeting place. This does not seem to be an important 
point and is probably a matter of local convenience. The same is 
true of the time. Equal success seems to have.„bejn B.st la^^ 
afternoons (htlO or 5 o* clock), evenings, or Saturday morning 
courses. It might be noted that f ailures can also be rep ^ at 

these times. It seems in general that the Ipcal interest that 
can be developed is more dependent upon course content, instruc- 
tors, and publicity than upon the exact of time jind place. 

It is obvious, of course, that conflict with other activities 
should be avoided in so far as practical, 

D) Text 

The overwhelming majority of the courses given tiised 
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little or no text material* The following is a distribution of 
materials reported for 1955-?6s 


Papers & Manuals No* Reported 

1* Local Notes and Papers 16 

2* Basic Training Manual on Statistical 

Quality Control^ (St« Louis Section^ ABQC) 11 

3. Mil-Std. 105-A 8 

U* **Quality Control Training Manual" 

(Iowa Section^ A5Q0) 3 

Extension Course in SQC by Westman 2 

6* General Motors Inspector's Training Manual 1 

7* Nav. Qrd, OSTD 60 1 

8* ASTM Manual on Quality Control of Materials 1 

Books 

1* "Statistical Quality Control" by E. L, Grant 13 

2, "Statistical Analysis" by Dixon & Massey 3 

3* "Facts from Figures" by J. M, Moroney 2 

U* "Statistical Analysis for Chemistry & the 

Chemical Industiy" - by Bennett & Franklin 1 

5* "Industrial Experimentation" by K. A* Brownlee 1 
6. "Engineering Statistics & Quality Control" 

by I* W* Burr 1 

7* "Statistical Theory with Engineering Applica- 
tions" by A* Hald 1 

8* "Inspection & Gaging" by C, W. Kennedy 1 

9* "Introduction to the Theory of Statistics" 

by Yule & Kendall 1 


It is the writers' opinion that more formal text material 
should be given to the students at these courses* Even though 
this might not be used in the course ^ such material mi^t prove 
an incentive to those taking the course to study further in the 
field* It also helps the student feel that the course is worth- 
while and that there is a scientific background to statistical 
quality control even though it is simplified for daily shop use* 

E) Tie-in Vftth Special Groups 

Often courses are given to appeal to a local special 
interest group* This might be an industrial or trade group. In 
these cases ^ the course is specifically adapted to the purpose 
at hand. In general^ these are f^iven by ASQC Sections on special 
request rather than part of a general education program. 

2) Instructors 

In general j it is felt that section courses should be on 
as professional a basis as possible* To this end^ the instructor 
should be an authority in iiie field of SQC and possibly a profess- 
ional educator. Since such a person is not always available > a 
well-known local practitioner of quality control or a professional 
educator in mathematics or statistics serves. There are generally 
found within the ranks of section members or local educational 
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instittitions* Generally^ more than one instructor is used 
a limited courseV alth^^ the practice of using too many inside* 
tors tends to destroy course cpntlnui*^* Many sections prefer two 
or three instniotOTs for a 15 to 20 hour course to create interest 
and variety, 

While general practice varies, it is felt that inpt^ 
should be paid a nominal amount to maintain section courses on a 
professional level. An average honorarium that has been used is 
approximately | 26 ,bO for a hour and a half session. It is necessary, 
however, to note that maiiy of oar best section courses have been 
taught by the most competent men in the Society at no charge, ' The 
fact that such men are not generally available to many Sectioij^ > 
however, ad^ emphasis to the need for a rigid professional approach 
to the problem of instructors, 

3) Budget 

While the purpose of ASQC Section Courses is not primarily 
to mahe money, it is necessary to consider cost axxi budgets. The 
following is a typical budget that might be considered for a soctipn 
course. This represents average costs of courses given in thp St, 
Louis area fpr a ten session course of one and a half hours ejachs 

Estimated Income 

10 Registrants @ $20 (members of A'SQC) 

10 Registrants f $30 (non-members of ASQC) 


Estimated Senses 


Hotel (10 nl^ts ® $12.50) $125,00 
Instruction fees 200,00 
Training Manuals 20 @ $1,00 20,00 
MIL-STDS 105A 20 @ 30^ 6,00 
NAV CRD Variable Sampling Plans 20 © 50^ 10,00 
Printing 50,00 
Postage 20,00 
Miscellaneous 5,00 
ASQC for 10 memberships 60.00 

$h96.00 


$200,00 

300,00 

$500.00 


Net Favorable Balance $ h.OO 

Note that ASQC members are charged an average of $20,00; 
non-members $30,00, The extra $10.00 for non-members, however, often 
is used to secure a membership for these people, 

h) Membership Tie-in 

About 20 % of the sections reported a membership tie-in with 
their training course charges. While a great many arrangemejnts were 
reported; generally, non-members were charged a $20.00 fee if|ith about 
a $10,00 additional charge for non-members. In almost ever^ ease, 
this included a membership in the ASQC althou^ seii^ral sectllons 
reported an option on this item. There seems to be no clear cut 
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^nion as to the desirability of this practice. It ts nrevalent 

successful enough in obtaining members for Jaany sections 
^^s several inetances, to3r! i1 

ws felt that members so obtained did not represent truly intereatad 
and permanent manbers and as such, were not desirabl?^ ^ interested 

?) Brochure and Publicity- 

course to'^L^’i^t^d awu 5*® * purposes to announce the 
«rr ^ receives itj and possibly to be used 

bulletin boards, etc. It should be efficient and 
professional in nature, but not garish or gaudy, Uenerallv 8 1/2 

d»irr.+™d ® billboard announcement. The back is 
registration form, and mailing seoticai. Of 
cwrse, other foMers ca* book forms have been used successfully. 

It is generally desirable to work with local printing or advertis- 
ing people who can advise and assist in this advertis- 

It is extremely difficult to obtain oioueh publicitv Thi* 

Sr.“S! Of 

the area and to all members of the Society* In certain infi+anoame 
broctores are mailed to an entire state 2 inSr!steS aS ^el 
quently. Chambers of Commerce of communities within a radius of 
fifty miles or other industrial trade groups In toe arerwill as,-ts+ 
Technical societies may participate and provide mailing lists or * 
include aMouncements in their mailings. Local co^s or un?^r- 

groups will often assist in publicising such 
a progTM th^gh their own publicity channels. In^any event* thev 
Should be notified and contacted to Lucit th;ir ^Sration.’ 

< 1 d. Attempts should be made to secure publicity in newsDaners 

statiSs^ofterh^** neighborhood newspapers. Radio and tele^sion* 
of tS^aS announcements 

Quality cS^oi? * ® announcements to "Industrial 

Pommi t+» ^ mailing is handled by toe local Education 

and the secretarial services of members in the larger 

s2^2 however, to use professional mailing 

^v^ financially able to justify this 

AW ^ d^ mailing organisations have mailing lists which 

2^a r?At?« ® and may be used for this purpose. Don't forget ASQC 
* ^'^"bers of Commerce and trade assoclItioM 

iSgs ortSrLS Purchased or rented for approved mail- 

6) Course Co-Sponsorship 

It has been found extremely desirable to have ASOC 

Com^rcerlducS oSf 

^stitutions, or industrial associations, Qenerallv the 

Other than permit the use of its na^ as a 
oo-sponsOT. In specific instances, the co-sponsorship ^Tao mSoh 
eyon th^ to include the mailing of announcements to their members 
or to providing mailing list to the local sections. ?t^y al2 
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include financial assistance and other forms It 
can specifically help in obtaining publicity through local newspapers, 
radio and TV stations, bulletins, etc. 

7) Questionnaires i 

Questionnaires can be extremely valuable both for the imme- 
diate and long-range planning of a training program. There a#e 
three types of questionnaire programs generally used. The first of 
these is a general information questionnaire circulated to th^ mem- 
bership and perhaps to a general area mailing list* The purpdse of 
this questionnaire is to get some idea of the interest of the po- 
tential registrants in the area. The following items might bq 
subject matter for such a questionnaires ■■ 

1) Selection of dato a^ 

2) Selection of possible subject matter from a submitted lis^ 

3) Occupational interests, 

h) Educational background of those interested. 

Another important questionnaire is usually given to 
enrollees at a training course at the first session. This includes 
such questions ast ii 

1) Industrial position^ 

2) Educational background, 

3) Field of activity, 

U) Reasons for taking Quality Control course, 

5) Source of infomatipn on the course being offered. 

Upon completion of the course, another questionnaire can 
be of interest. This questionnaire would concern itself with: 

1) Other courses or subjects that the enrollees wtnild be in^ier- 
ested in> 

2) Comments on the arrangements for the present course, 

3) The nature of the material presented (too technical, too: simple, 
mors illustrations # more explanations, etc, ), 

U) Areas of application that the individual might anticip^^ for 
the material presented, t 

5) Questions oh Society participation, 

■ li ' 

8) Reports ii 

It is extremely important that a detailed report on each 
course be prepared. This should include preparation, procedure, 
operational details, and financial details. The Saddoris Award 
Competition encourages this through tbe points given by the 
Committee on Education aiid Training for such reports. The file of 
these reports provide the basis for development and improvement of 
the educational programs of the individual sections, as well as for 
the National Committee on Educatipn and Training, Much of tb® 
information contained in this paper is based on such sec tionij reports, 

9) Certificates 

It is desirable to give each registrant who attends^ practi- 
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cally all the sessions of an ASQC training course a **Certificate», 
Again, this is essentially psychological in its effect and is 
appreciated by the student and by his company which usually pays 
his registration fee. This certificate should merely state that 
the individual has attended a course covering a specific number of 
hours given by the ASQC Section at a certain time. This certificate 
should make no statement whatsoever as to the individual's qualifi- 
cations in the field of quality control or related activities. In 
general, this certificate is signed by the President of the local 
section and the instinictors, 

10) Time-table 

The following is a time-table that is typical of that 
necessazy for the average course. This, of course, must be adjusted 
to the individual needs and activities of the section. It is 
offered here only as a rough guide to the major important planning 
schedule. 

Bays Prior to 


Item Start of Course 

Select general course content and instructors 90 

Brochure, general outline 80 

Prepare detail course outline 75 

Finalize arrangements for room and instructional 
materials 72 

Finalize brochure design 70 

Finalize brochure printing arrangements and copy 
to printer 65 

Start first mailing 1*5 

Start second mailing — iS used 30 

Complete mailing program 28 

Follow-up on publicity to assure planned distribution 20 
Check of arrangements for classroom and material lU 

Check on arrangements for person to Introduce course, 
handle late registrants, etc, 10 

While the above outline may indicate areas requiring attention 


and some of the approaches that have been used successfully, it is 
necessary that ea<^ section course reflect the needs and interest of 
the local community. It is only through satisfying this local interest 
that section courses have proved to be such a successful activity of 
the Society, The three basic course purposes indicated at the begin- 
ning of this paper presuppose the need. For this reason, in closing, 
we should like to stress the fact that service to the local community 
must be an underlying premise of all the matters considered herein. It 
Is our feeling that the success of the ASQC and of its activities is 
based upon the fact that it has well served the Industrial community. 
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MULTIPLE COMPARISONS IN THE JUSAL^SIg, 0F,.^V^ ^ ^ 

David L. Wallace 
The University of Chicago 

1. Introduction . , 

A common type of experijnental data^^ cpns^^^ of mca^r^ent^^^ 
outcome of some process under several sets of conditions* J?.or 
the yield of a chemical process is measured for several rims with each 
of six different catalysts* Or the knock rating of fuel is measured for 
samples from several lots from each o^^^ Several vari- 

able conditions may be studied at once as when impact strength is mea- 
s\ired for ceramic insulators fired each of five different t^es of 
glazes and assembled by each of five operators. 

In experiments such as these, interest usually centers in tbe dif- 
ferential effects of the conditions; catalysts or suppliers dr |laze 
types or operators. The effect of a condition is prdi^^ interpreted 
as the average performance of the process under that condition pfer a 
long sequence of repetitions. A strong desideratum for the statistical 
analysis of such data is a method for the effects of ariy two 

conditions, making proper allowance for the ^ of the observed 

data. The purpose of this paper is to show how this need can cafily 
met, using a method due to Tukey (l). The problems and method aife 
similar to those in the m comparisons of several treatments 

a standard, presented to the 1955 convention by Dunne tt (2). 

2. The proposed multiple commrisons method . 

Experimental data given (3) will be used to illusirate 

the method. During a filtering process in the chlorsulphonation : of 
acetanilide, some of the product is lost. The percent loss was pleasured, 
for three samples of each of five different blends plapetanili^ 
the data are sho^m below, (in the experiment, the rows corresponded to 
blocks of time in production, but this is ignored here to simplify the 
exposition.) 

PERCENT LOSS OF PRODUCT 
BLEND OF ACETANI LIDE 


Means 

Variances 


4 

B 

£. 

D 

A 

16.9 

18.2 

17.0 

15.1 

18.3 

16.5 

19.2 

18.1 

16.0 

18.3 

17.5 



Md 

17.8 


17.0 

18.2 

17.5 

16.3 

15.8 

.25 

1.10 

.32 

1.89 

.175 


The multiple comparison procedure requires the calculation of a 
quantity denoted by WSD (wholly significant difference) , conveniently 
found in four steps. 

2 . . ■ ■ 

1. The estimated yariance s pf a single observation is .found. 
Here it is the average of the five variance § pf the obsiervatiaas 
within blends and is .86 with ten degrees of freedom (DF*) . 

For k groups of n observations each, there will be k(n-l) 
degrees of freedom. 
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2. The stenda rd error of a difference of two means is found as 

J^^^n ^ * h.ere equal to *76 with n = 3, 

3. The LSD (least significant difference) is the product of the 
standard error of a difference of two means and the 5% (two- 
tailed) critical value of Student* s t with the same degrees 
of freedom as s2, A brief table of t values is given in 
table 1 and more values can be found in any statistics text. 
Here t is 2.23 and LSD = (.76) (2.23) = 1.7. 

4. The factor converting LSD to WSD is taken from 

table 1 according to the number of groups and degrees of free- 
dom of s^. Rough interpolation where necessary in this table 
is adequate. For five groups (blends) and ten degrees of free- 
dom, the factor is 1.4S and WSD = (1.7)(1.4B) = 2.5. 

The WSD is then used to form multiple comparison statements. 

For any observed difference in blend means, the WSD is used as an 
"allowance” for variability. Thus a few of the possible conclusions are 

(i) . The difference in percent loss between blend E and blend 

D lies in the interval 18.8 - 16. 3 i WSD or between 0.0 and 

5.0. 

(ii) . The difference in percent loss between blend B and blend 
D lies in the interval 18.2 - 16.3 ±2.5 or between -0.6 
and 4.4. 

The WSD was chosen so that all possible comparisons will be correct in 
95% of such experiments. In about 5% of such experiments, one or more 
of the conclusions will be incorrect. This is called a 5% error rate 
experimentwise and will be discussed further in the next section. 

More complicated comparisons than simple differences between blend 
means can be made if desired without increasing the experimentwise error 
rate. For example: 

(iii) . The difference between the meqn of the percent losses for 
blends E and E and for D lies in the interval 

*“(18.8 -f 18.2) - l6.3i 2.5 or between -0.3 and 4.7. 

(iv) . The percent loss for blend D lies in the interval 
16.3 ± 2.5 or between 13.8 and 18.8. 

Conclusion (iii) follows from (i) and (ii) by averaging, but is 

entirely different — not strictly a comparison. Generally, if 

c^x^+ ^2^2“^ ••• 4* is some linear combination of the group means, 

then the proper "allowance” is the product of the WSD and the larger of 
(sum of the positive c.) and (—sum of the negative c. ) • In all 
examples above, this latter factor was one. ^ 

Recall the meaning of any conclusion, say (ij) . The statement is a 
prediction with a 5% error rate experimentwise tnat in repeated use of 
this production process, the percent loss of product using blend B 
will average between 4.4 higher and -0.6 lower than the percent loss 
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using blend D* But the ” allowance" allows for only those sourcM of 
variation occurring in the experiment. Thus if variation in Derc;ent 
loss between batches of acetanilide is greater than within batches, 
and if all of the samples in ttie experiment came from the same batch, 
then the predictions will not be adequate for new batches, and the 
true error rate if sp used may be much higher than the nominal 55^* 

The comparisons give a rather complete summary of the results of 
the experiment. One might be tempted to discard the entire set of 
conclusions and replace them by the simple one that there are no :Signi- 
ficant differences between blends. But this would be very waste&l. 
Blend D is surely as good (i.e. less percent loss) as blend |B and 
may give as much as 5.0 less percent loss (which would be almost one- 
third less). Had the lower liinit been 0.1 instead of 0.0, the differ- 
ence would have been significantly different from zero, yet not Appre- 
ciably more useful. The experiment may be too small to yield adequate 
infomifition, but the multiple comparison intervals indicate nqt inly .. 
whether a difference is significantly different from zero, but atsp how 
large it may be. 


3. WSD. LSD and error ra tes . 

If there had been only two blends, standard analysis would 


Student's t distribution to set a confidence interval on the differ- 
ence of the average effects. For two groups of n measurements’’ each. 


the interval would be 



±LSD 


except that the LSD uses the estimate of variance based on all 
groups. Each such statement is a 9^ confidehce interval. 'I 


All of the comparisons of section 2 could be made UvSing LSK instead 
of WSD, and the all be narrower. But there is a serious 

objection tp this procedure because of the large number of povssible com- 
parisons and the resultant large nuraber of incorrect statements.' That 
only a few of the possible comparisons would be made is not prp|ectioh, 
since those few are chosen after looking at the data as most interesting. 

There are -IkCk-l) possible differences of k means— ten differences 

of five means. In a long sequence of experiments with five groiips, the 
number of incorrect LSD statements would be about half the number of 
experiments and with more groups, the ratio would be higher. Because of 
dependence among comparisons in one experiment, several incorrect state- 
ments will often occur together in one experlaent. Nevertheless, with 
five groups, using the LSD comparisons (and assuming the degree A of free- 
dom to be large), 29S6 of experiments will contain at least one jjnrpni 
statement; with ten groups, 67%; with three groups, 12: These last 

figures are called the error rate experimentwise— the percentage of 
experiments in which one or more statements are incorrect. 

The WSD coiJ^arison system is based on the premise that the: more 
stringent control of error rate esqperimentwise provides the user a more 
adequate set of conclusions than the looser LSD system with evtpr rate 
per comparison. The * WS]f of table 1 is just the necessary factor by 
LSD 
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which the LSD must be expanded to reduce the error rate to 5 % experiment- 
wise. It is interesting to note how little expansion is needed to con- 
trol the error rate and to see how it varies with the number of groups 
and with degrees of freedom. 


Relation to the analysis of variance F-test . 

The conventional analysis of variance procedure consists in decom- 
posing the variance into several parts and carrying out one or more 
F-tests. The results of this procedure for the example are summarized 
below* 


Source of Degrees of 

Variation F reedom 


between blends 4 

within blends 10 


Sum of 
Squar es 

11*56 

8.64 


Mean 

Sqiaare 

2.89 

.86 


F-ratio 

3.36 


The F-ratio is lightly less than the 5% critical value 3.48 of F with 
4 and 10 degrees of freedom, so that there are no significant differences 
among blends. This- sole result of the F-test is approximately equivalent 
to one of the many conclxasions available from the multiple comparisons 
statements and is certainly not an adequate analysis of the experimental 
data. 


The analysis of variance decomposition serves a very useful function 
in multiple comparisons procedures in the calculation of the variance 
2 

s of a single observation. The denominator mean square of the F-test 
for between blend effects is exactly the estimated variance of a single 
observation calculated in step one in the calculation of WSD. This will 
be true generally and will be particularly useful in more complex sets 
of data. 

5. Applications to raore complex designs . 

The WSD multiple comparisons procedure can be aprilied without dif- 
ficulty to many sets of exi^erimenta.l data more complex than the single 
classification scheme with equal numbers of replicationvS thus far consi- 
dered. If •••, ^ are the means for suppliers in an experiment 

involving suppliers, operators, machines, and days, and if each mean is 
based on the same nxiraber of observations, then provided that the vari- 
2 

ance s and its degrees of freedom are obtained correctly, the proce- 
dures for getting allowances for differences of the supplier means is 
just as in section two. The correct variance s^ is most easily ^found 
as the denominator mean square which would be used in the analysis of 
variance F-test for the raain effects of suppliers. In this fotmi, the 
necessary calculations are explained in most texts on applied statistics 
or on the design and analysis of experiments. Using the same experimen- 
tal data, multiple comparison statements on the difference of machine 
effects (or operator effects) could also be laade (using a different WSD, 
of course) • 

All analysis of variance procedures become more difficult when 
unequal numbers of replications occur for different conditions. VFith a 
single classification into groups of unequal size, a natural modification 
of the WSD procedure can be used. The variance s^ can be obtained 
frora the analysis of varir.nce decomposition (or as the weighted average 
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of yithih group variances). In step two, the standard error !;qf i^e 
difference of means of gro;:^)S of si^re and will be 

J s^ — and will be different for each oossibie difference in 

“i V . - • ■ ■ 

means. For each difference of means, the LSD and WSD and allowa^ice are 
found from the standard error exactly as with equal sized groups; The 

use of the factor does not give exactly a 5 % error rate fxperi- 

mentwise for the resulting multiple comparison statements, but studies 
Kurtz (4) indicate that the suggested procedure is a, fairly good 
approximation. The actual error rate appears always to be spme\Aat le^s 
than 55^. .-if ■ ■ 

6. Shortcut methods . 

When the data consists of a single cla s si fi cation int^^^^ of 

equal size, short cut procedures using ranges of the measuremeiits In a 
group as estiinates of variability have been worked out. The sv^ of 
the within group ranges is muitiplied by a tabled factpr dependijag on 
the number and size of the groups and on the error rate to give directly 
an allowance for ^differences of group totals. An allowainQe for' dif- 
ferences of group means, if that is preferred, is obtained by dividing 
by group size. For the numerical example of section two, the total 
range is (1.0 4- 2.1 +1.1 +2.7 +1.5) = S.4 which gives, whep multi- 
plied by the critical factor an allowance of 7.9 for differences 
of blend totals or, an allowance of (7.9)/3 = 2.6 for differences of 
blend means* This compares closely with the all.Qwance of 2.5 obtained 
by the more efficient , me variances. The allowances a^e used 
in exactly the same way. 

Tables of the critical fa.ctprs were given by Tukey (5) and - can also 
be found in (6), (7), ( 8). (The entry for 5^ error rate for fpur 

groiips of size two is given incorrectly in (5) and (6) as 1.98. It 

should be 1.78.) Similar but slightly more complicated range m|thods 
for double classificatipn into rows and columns were given by Tpkey (5) 

(also in (6) ) and modified by Kurtz et al (9) (also in (7)). 

7. Other systems of multiple comparisons . 

Several o*bher systems for multiple comparisons state- 
ments have been proposed for use in problems like these. -system 

has certain advantages and disadvantages. Dunnett (2) has constructed 
a syst era designed for problems in which one treatment or method is a 
standard or control. His system gives shorter allowances for tke com- 
parisons of each treatment with the standard at the cost of longer 
allowances for the less important comparisons of two new treatments. 

The most important alternative system in which all differences of 
means are treated alike is “^at proposed by Scheffe (10). In Construct- 
ing allowances for the dlfferehces of group ^ m is the sejme as the 

factors corresponding to those of table 1 are all larger. This unal- 
loyed disadvantage is sometimes compensated for by its superioif mathema- 
tical manageability (e.g. for handling unequal sized groups) aM by its 
shorter (than the WSD system) allowances for more complicated compari- 
sons such as the comparison (iii) of section two or the regression 
coefficient of mean yield on temperature where the groups corrispond to 
different temperatures. 
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For some purposes of experiments, none of these types of data analy- 
sis and summary are relevant. If the sole object of the experiment is 
to pick the best supplier, the analysis is easy: pick the supplier with 
the best mean. The real statistical problem is in designing the eB^eri- 
ment to give a sufficiently accurate choice. Bechhofer (U) has treated 
this problem. 

The table of factors . 

Table 1 gives a factor for converting an LSD to a WSD with 5^ error 
rate experimentwise for a selection of values of the number of groups 
and the degrees of freedom of the variance estimate. The first column 
gives (two-tailed) critical values of Student's t. Other values of 
t can be found in any text or set of tables. Other values of the fac- 
tor, adequate for practical use, can be obtained by rough interpolation 
in table 1, or alternatively from table 29 of Biometrika Tables (12) by 
the relation: 

[ WSD 1 ^ Upper 5% point of studentized range of k groups . 

J2 (two-tailed 5% point of t) 

Table 1 was obtained as slight modifications of tables of Tukey (1) and 
Biometrika Tables (12). 


Factor to convert an LSD to a WSD for multiple comparisons of 

k groups with error rate experimentwise and with DF degrees of free- 
dom for variance estimate. The first column contains two-tailed 5% 
critical values of Student's t. 


k. ntimber of 


t 

DF 

3 

4 

5 

2.45 

6 

1.27 

1.42 

1.54 

2.31 

B 

1.25 

1.40 

1.50 

2.23 

10 

1.24 

1.38 

1.48 

2.13 

15 

1.23 

1.36 

1.45 

2.09 

20 

1.22 

1.35 

1.44 

2.02 

40 

1.21 

1.33 

1.42 

1.96 

00 

1.20 

1.32 

1.40 


groups 


6 

8 

10 

15 

20 

1.63 

1.77 

1.88 

2.06 

2.19 

1.58 

1.72 

1.82 

1.99 

2.11 

1.56 

1.68 

1.73 

1.94 

2.06 

1.53 

1.64 

1.73 

1.83 

1.98 

1.51 

1.62 

1.70 

1.84 

1.94 

1.48 

1.59 

1.66 

1.79 

1.88 

1.46 

1-55 

1.62 

1.74 

1.81 


9. References . 

(1) Tukey, J. W. , "The problem of multiple comparisons," Duplicated 
manuscript, Princeton University, 1953* 


(2) Dunnett, C. ¥. "Multiple comparisons with a standard," National 

Convention Transactions 1955 . Ninth annual convention, 
American Society for Quality Control, p. 435-491. 

(3) Davies, 0. L. (Ed.) The Design and Analysis of Industrial Experi- 

ments . Oliver and Boyd, London, 1954* 


(4) Kurtz, T. E. , "An extension of a multiple comparisons procedure," 
Unpublished PhD thesis, Princeton University, 1956. 


284 



(5) Tokey, J. ¥• ”Qaick and dirty methods in statistics, part II. 

Simple analyses for standard designs," Quality Control Con- 
ference Papers, 1951. Fifth annual convention, AmericariV' ' ‘ 
Society for 189-196. 

(6) Duncan, A. .T. Quality Control and Industrial Statistics , Richard 

D. Irwin, Inc., Chicago, 195^ • 1?ahles Ll and IjS. 

(7) Lindsay, G. (Ed.) Handbook of Social Psychology . Addis on-Wes ley 

Publishing Co., Cambridge, Mass., 1954 • Chapter 8: Selected 
< 3 uantiiative techniques. 

. ■ ii ■ . : 

(8) Federer, W. T. , Experimental Design . The Macmillan Co., New York, 

1955, Table II-4. :■ 

(9) Kurtz, T. E. , Link, R. F. , Tukey, J. W. and Wallace, D. L. "Some 

short cuts to allowances," Duplicated manuscript, Prinpeton 
University. 

;i . . ; . 

(10) Scheffe, H. "A method for judging all contrasts in the an^iysis 

of variance," Biometrika 40 (1953), 87-104* 

(11) Bechhofer, R. E. "Multiple decision procedures for ranking means," 

National Convention Transactions 1955 . Ninth annual cojivention, 
American Society for Control, pp.' 513-519* 

(12) Biometrika T a bles for Statisticians . Edited by E. S. Pearepn and 

H. 0. Hartley, Cambridge 1954* 


285 



286 



STATISTICAL METHODS FOR ANALSfZIMG PERFORMANCE 
VARIATIONS OF ELECTRONIC CIRCUITS 

R, H* Hinrichs :■ 

Convair 

A PJviaipn ^ General D7najaics Corporation ;; 

I, Introduction 

Reliable operation of electronic equipment is reco^ized as a: goal 
which is of great importance to our defense effort • However, the com- 
plexity of high-performance electronic equipment complicates the jproblem 
of achieving reliable operation, Attenqpts to reduce ccmplexity help 
up to a point, but we must obtain reliability in spite of compleicity* 

Reliability can not be obtained by testing and inspection alone. Re- 
liability must be designed into the equipment. To accomplish this re- 
quires a well-rounded reliability program involving several functions. 

This paper considers only one of these functions : the assessment 'jpf parts 
compatibility. 

It is first necessary to explain what we in the Convair Astronautics 
Reliability Group mean by the term ^parts compatibility”, because we use 
the term in an unustu^l way . We know that the performance characlferistios 
of manufactured electronic devices ya^ because of variations in ^ithe 
electrical characteristics of parts used in their manufacture, Ijf there 
is a high probability that the performance of the equipment remaijns with- 
in tolerance, when any combination of specified parts , randomly selected 
from stock bins, is used; then we say that parts compatibility has been 
achieved. On the other hand, if the equipment performance is out of 
tolerance, even though all of the parts are good and within tolot^lance, 
then we have an out-of-tdlerance failure. 

Note that this definition of parts compatibility relates only to out- 
of-tolerance failiares. It does not relate to catastrophic failitfes, those 
which occur if an electronic part breaks, shorts, opens, or burns out. 
Non-occurrence of catastrpphio failures, it should be emphasized,: offers 
no assurance that out-of-tolerance failures >riJul„n<^ occur, ;[ 

Assurance of parts compatibility may be obtained by production test- 
ing, and, of course, such testing should always be done as ”proof of the 
pudding.” However, such measurement after the fact of manufacture is 
only proof of accomplishment. To prevent out-of-tolerance failures, 
something else is needed, and that is a method of assuring that i^ts 
compatibility has been achieved while the equipment is in the design 
phase, that is, prior to manufacture. Such assurance could be obtained 
by experimental methods. But for a complex piece of equipment, with 
dozens or hundreds of parts, an astronomical number of tests wou)|d be re- 
quired to check a statistically significant number of combinatioins of 
parts. 

What is needed is sn analytical or mathematical method of assessing 
parts compatibility while the equipment is still in the design phase. In 
the remainder of this paper two such methods will be discussed. .:The 
methods make use of digital computers to handle the huge mass of calcula- 
tions involved. The auxiliary operations involved will also be discussed. 

II. Operations and Methods 
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In order to asstire parts c<»i)patibllit7 in a design^ It is first 
necessary to know the nature of the variations in the parts characteris- 
tics themselves. That iSf one must obtain statistical distributions for 
all of the parts. This is done at Convair by measuring all of the parts 
in Receiving Inspection. A copy of these data is sent to the Reliability 
Group. This procedure also as stares elimination of the out-of -tolerance 
parts. The gathering and analysis of this parts data is an expensive 
project, but reliability can not be bought cheaply. It should be further 
pointed out that gathering the parts data is not a peculiar requirement 
of the particular methods chosen. Farts data are necessary to any method 
vhich is xised to assure parts compatibility. This is because the statis- 
tical variations in the parts characteristics are the causes in a oause- 
and-effect relationship. The effect is the variation in the performance 
characteristic of the manufactured equipment. 

At Convair, we make use of digital computers in the analysis of the 
parts data from Receiving Inspection. The data consist of measturements 
of the resistance of resistors, and the capacitance and sometimes the 
Q-f actor of capacitors. The data are identified by standard part number 
and sent to the Digital Computing Laboratory. Here an ISM 65O computer 
is used to obtain the histogram and statistical parameters of each lot of 
parts. The statistical parameters used are the lot size, mean, standard 
deviation, and the first eight statistical central moments. (Ref. 1) 

These results and the tabulation of the histogram are printed out on a 
page and also punched out on IBM cards. The cards are kept in order to 
ccxabine the results of several lots of the same part* Thus there is 
available a library of parts data, containing all of the information 
accumulated to date, on each standard part. 

It is also necessary to have data available on the distribution of 
electron tube characteristics. This is obtained by running tube tests, 
and measuring all of the characteristics thought to be needed in further 
analyses. Here there are so many variables and levels of each variable 
that an orthogonal block design for the test is set up by a statistician, 
in order to do the testing most efficiently. The restilts of the test are 
subjected to the analysis of variance to determine the significant re- 
lations. Then curves are fitted tq_ the tube characteristics by least- 
squares regression techniques. The IBM 65O computer is "used for the 
analysis of variance, and the IBM 704 computer is used for the curve- 
fitting* Tube characteristic curves are obtained for static currents and 
for transconductance, amplification factor, and plate resistance. Also, 
equations and curves are obtained for the standard deviation, and third 
and fourth statistical central moments of the above variables. 

All of this tube data and the parts data previously described is 
filed, and constitutes the basic information needed for the mathematical 
methods. 

There are two such methods currently in use at Convair Astronautics, 
the Monte Carlo method and the method of moments. I will not go into the 
detailed Bsathematics involved in these methods, but I will describe their 
main features. 

The Monte Carlo method utilizes the basic laws of probability to de- 
termine a resxilt. Here we are trying to determine the statistical varia- 
tion in electronic circuit performance from a knowledge of the statistical 
variaticMi in the tube and parts characteristics. 
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The first step is to determine a mathematical r^^ 
circuit performance clw^scteristic^^^^ parts characteristics, this 
is expressed in the f pimi of ^ ^ a set of equations. Circuit 

theory or network analysis is used to obtain the equations. Frcaa the 
equations, the circuit performance can be calculated for 
of parts characteristics, In the Monte Carlo method, this calculation is 
made and repeated many times. Each time a different combination of parts 
characteristics is^^n^^ obtain meaningful results, the 

numbers representing the parts cl^racteristics must be chosen at i^andom 
in such a way that they will have the same statistical distribatl<^ns as 
the parts characteristics^ they represent. The parts and tube data, in the 
file previously described, are used to determine these statistlcaji dis- 
tributions. 

In practice, both the generation of the random numbers and this cal- 
culation of the circuit performance from the. are done 

by the IBM 704 computer . The resist is a i^ge quantity of numerical 
values of the circuit performance characteristic. A histogram .of: these 
values may be plotted, or an approximate statistical distribution- mfi^r be 
obtained by any of several standard statistical methods. (Refs. 2 and 3) 
This is then the desired result. 

In the method of m^^nts, the statistical moments of the perfbrmance 
characteristic are obtained 

characteristics. The moments are statistical parofleters 
several impoitant properties. J'or example, the first moment is the mean, 
or average value. The standard deyiatlon is the square root of the 
second central moment. Higher-order moments characterise other i^eatures 
of a statistical distribution. Thus the moments have the import^t 
property that th^ are able to summarize, in a numerical way, the main 
features of a large body of data* It is also possible to constf^ct an 
approximate statistical distribution, if several of the moments ^re known 
(Itefs. 2 and 3)# 

The method of mments then of the folloirtng general steps : 

1. An equation is written Which esqaresses the circuit perfonji^ce in 
terms of the parts characteristics, as was done in the 

Method, 

2. The equation is replaced by a Taylor's Series.. For our p^poses 
we can think of the TaylcKT *8 Series in ^ t^ 

Each of the parts characteristics has an ayeyage value and a dis- 
tribution of values about the average. Any individual pairt has a 
characteristic above or below the average value, and this; is con- 
sidered as a positive or negative deviation from the averiage value. 
Also, the performance characteristic deviates above and below its 
average value. The Taylor's Series is an equatl dh which expresses 
the relation between the average value of the parts characteristics, 
the parts deviations, the average value of the performance char- 
acteristic, and the performance deviation. It would therjefore be 
ideally stdted for the present purpose, except for the fact that 
it is an approximation. However, for those problems for 
approximation is good enough, the Taylor's Series is conyenient, 

It also has the tremendous advantage that it is a standard mathe- 
matical model; that is, it is a standard fqm of ^Ich 
may be used for a large variety of problems by merely putting in 
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different sets of numbers for different problems, 

3* The next step in the method is to find the statistical central 
moments of the performance characteristic from the statistical 
central moments of the parts characteristics. Here the Taylor* s 
Series is used, as well as a set of equations relating the central 
moments. These equations were derived especially for this purpose, 
and have been programmed and put on tape for use with a digital 
computer. This program tape is limited to fifteen parts or tube 
characteristics, but this is sufficient for most circuit applica- 
tions. This is where one of the advantages of using a uniform 
mathematical model, such as a Taylor’s Series, is realized: This 
same tape may be used for all problems, subject to the limitations 
previously mentioned. 

4. After obtaining the central mtanents of the performance character- 
istic, its statistical distribution is obtained by ar^ one of 
several standard statistical methods. 

More detailed mathematical descriptions of the method of moments are 
given in two Convair reports, listed in the references (Refs. 4 and $)• 


The advantage of the method of mcanents is its conciseness. Calculations 
are done only once, and a few numbers are obtained, which summarize a 
large amount of information. The disadvantages are the loss of detail in 
so stmnoarizing, and the errors due to the various approximations which 
are made. So far, it is felt that the advantage outweighs the disad- 
vantages , 

III, Seme Problems 

The Monte Carlo method is presently being used to determine the varia- 
tion in transient response of a fairly complicated circuit. The results 
were not ready in time for publication in these minutes. The Monte Carlo 
method is not new and no difficulty is expected. This problem is a good 
illustration of the main advantage of the Monte Carlo method: The method 
is convenient for problems which must be done entirely by numerical means, 
because they are too complicated to do by analytical methods. 

The method of moments was first tried on a circuit which was designed 
solely to test the method. This circuit is shown in Figure 1. The per- 
formance characteristic analyzed was the phase shift of the transfer- 
function. Twenty of the circuits were built from twenty sets of randomly- 
selected parts and tubes. The parts and tube characteristics were 
measured and recorded, and their statistical distributions were calculated. 
The distribution of the resistance of the 560-ohm resistors is shown in 
Figure 2, It should be noted that this distribution is far from normal, 
although a sample of twenty is too small to judge the true shape. The 
distribution of the amplification factor of the twenty type 5814 WA tubes 
is shown in Figure 3* This looks more nearly normal, but is somewhat 
skewed. 

The statistical moments of all of the parts were used to calculate 
the statistical moments of the phase shift. Then the distribution of the 
phase shift was calculated. The result is shown as the dashed curve of 
Figure 4* The phase shift of each circuit was also measured experimentally, 
The resulting distribution of the measurements is shown as the solid curve 
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of Figure 4* The experimental average value of the phase shift ie about 
5^ greater then the calculated eyerage value. This is believed tp be due 
to neglecting the distributed capacitance of the viringi when wri|ing the 
original phase shift equation. To check this ^ a modified Monte G|rlo 
method was used. The phase shift was calcidat^ from the equation » by 
using the twenty sets of measured parts characteristics. The reacting 
distribution is show as the dotted cury ip 4. This curvf agrees 

closely with the one obtained by using the method of moments. This 
demonstrates an important fact: The method of moments is as good: as the 
original equation, but great care must be taken in writing circuit 
equations to make sure that all effecta are accounted for. 

The calculated value of the stindai^d deyiatiqn^^^^ p^^^ phase sliift 

was about greater than the experimental value. This was thought to be 
partly due to errors in the instruments used for to the pai*ts and 

tube characteristics. Of course part of the errors are due to thjs 
various approximat ions involved in the methods. il 

Another problem in which the method of moments proved useful was that 
involving the frequencies of two radio beacons. This was a systerias 
application of the method, rather than a circuit problem. The twp uhf 
beacons in a missile were required to operate on the same frequen^, or 
within a required tolerance. The antennas are connected to the bjjiacons 
by coaxial cables. These cables are cut in the factory, but the tbler- 
ance on cable lengths is so wide that the beacon ^equency may be any- 
where within a considerable range. An approximate relation between the 
cable length and the beacon frequency was known. It was desired to find 
the statistical distribution of the differenc in thf two beacon 
quencies. A close approximation to the desired result was obtained by 
using the method of moments. The cumulative probability distribution 
was calculated and it ®h^^^ in Figure 5. It is too early is the program 
to obtain verification of the cal<mlatlohs« in this case, the 

analysis was useful in influencing a designer’s decision. This piroblem 
is a case in which the simplicity of the method of maaents was ad(l 
vantageous. In fact, the problem was so simple, that the niii^rical work 
was done on a desk;^c^^^^ by a digital computer. | Had 

the problem been slightly more complioated, or had greater aeouraOy been 
required, a digital computer would have been tised. 

IV. Conclusions 

Some general remarks should be made about the scope of the methods, 
and about their future^^W 

First, they are analytical or mathenwtical mathods. Therefora their 
use is limltad to Pi^^blems which can be expressed by eqtaations. However, 
because they are mathematical methods, their use is not restrictad to 
electronic circuits and systems, but they should find use in the 
statistical analysis of many kinds of physical systems. 

Second, the methods have so far been applied only to systems under 
ambient environmental conditions. This is considered as a prelliii(inary 
step which is necessary to prove the methods. If the statistical varia- 
tion of the performance characteristic is successfully calculated for 
ambient envirpiptental conditions data taken under ambijent con- 

ditions; then it is beiieved that the same mathods be successfully 
used to calculate the statistical variation of the performance 
characteristics under seryic© environmental conditions from parts data 
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taken under service environmental conditions* 

Thus much work remains to be done^ before we can have asswance of 
parts ocaapatibility while equipments are still in the design phase* In 
carrying on this work, digital computers will be indispensable for per** 
forming the tremendous amount of calculations involved* 


1* H* Gramer, ••Mathematical Methods of Statistics, •• 1946» Princeton 
University Press, Princeton* 

2. J* T* Kenney and E. S* Keeping, ••Mathematics of Statistics, Part Two,** 
second edition, 1951, D. Van Nostrand Co* Inc*, New York* 

3* C* C* Craig, ••A New Exposition and Chart for the Pearson System of 
Frequency Curves, •• Annals of Mathematical Statistics, Vol* VII, 

March 1936* Pp* 16-28* 

4* R* H* Hinrichs **4 Statistical Method for Analysing the Performance 
Variation of Electronic Circuits,** Convair Report No, ZX-7-009, Oct, 

3, 1955. 

5. R. H, Hinrichs, ••A Second Statistical Method for Analyzing the Per- 
formance Variation of Electronic Circuits,** ty R* H* Hinrichs, Convair 
Report No. ZX-7-010, Feb* 15, 1956. 

The above two reports may be obtained by addressing a request to: 
Commander 

Western Development Division Headquarters 
Air Research and Development Command 
Post Office Box 262 
Inglewood, California 

The request should be addressed to the attention of ;ilDTG, and Include the 
report title, number, date, contract nmber (AF-04(645)-4) and the Con- 
tractor (Convair Astronautics Division). 
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Probability Density 



Amplification Factor, ji* 


Fisfure 3. Probability Density Function of 
Amplification Factor 



Figure 4. Comparison of Methods 
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CUMULATIVE DISTRIBUTION FUNCTION, H^) 



Figure 5* Probability Distribution of Beacon 
Difference Frequency 
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CONTROLLING THE QUALITY OF MANAGEMENT DECISIONS 


Rath & Strong, Inc# 

Industrial Consultants 
Boston, Massachusetts 

In working with many industries we have come across thre® kinds of 
’’quality*’ - each quite different* Quality of Conformance, which: most SQC 
people strive to attain; Quality of Design, which is usually an ’engineer- 
ing department function relating to grade of product (specifications) and 
to ingenuity of design; and Quality of Management Decisions - an: area 
being touched by articles and books on DecisioriL Theory and by Operations 
Researchers. Each kind of quality can be improved with the aid i:of cer- 
tain statistical techniques. Perhaps some day several of the techniques 
in this last area may be collectively known as MQC as they assist in im- 
proving the Quality of Management Decisions. -j 

■iji;.. ' 

Successful industrial management makes sound decisions based upon 
judgment and upon an ability to find facts. But facts, in the increas- 
ingly involved industrial situations today, are often elusive, i; 

industry invests rather heavily in the pursuit of facts. Re- 
search laboratories are continually busy in this chase. Engineers run 
tests on equipment and on part changes. Process people try new";methods , 
personnel men follow up on aptitude tests to check the extent o£ corre- 
lations, and inspection foremen test lighting changes, alternate gages - 
the list in progressive plants can seem endless. ;! 


M8C uses three principles of imperfection in bringing facts to the 
surface. The first almost invariably shows the uneven (and thus! most 
helpful) distribution of effect under management consideration yersus the 
causes or sources of that effect. They often can be appropriately con- 

sidered ’’the elements to be controlled”, (l) It can be the simple plot- 


ting of each department's contribution to an important plant-wide func- 
tion in a given period, such as total scrap or rework cost; eacSl sales- 
man's contribution to: total sales; each vendor ^s trouble with returned 
parts; or the variation of each operator from standard time. I| the ef-: 
feet is plotted as an accumulated value from the smallest contribution to 
the largest, a curve drawn through these points demonstrates this first 
principle of imperfectionj- in any system of causes or sources qf an. ef- 
fect, relatively few of them generally account for a large proportion of 
the total effect. " 


"Pareto’s Curve*', here showing 
70% of the effect cotning from 
the seven major troubles — 
from L to S. 


tg 'q p 


Al I others- 


Troubles 
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Management thus has a ”road map’^ to guide its attention for fruitful 
results in influencing the effect under consideration. For example if 
the effect is number of customer complaints (or schedule delays) working 
on relatively few of the causes or sources, say components of a complex 
assembly, can bring about a major reduction in the total effect. 

Just as the first principle serves as a road map, there is a time 
when a street directory helps as management nears its destination. The 
second principle of imperfection draws upon a fact which made SQC what it 
is today: repetitive activity inherently displays variable results. A 
reduction of the spread of such variation and/or -a. change in its average 
level is often an object of management control. It can generally be 
brought about by examining a breakdown of the .total variation into cer- 
tain components. The second principle of imperfection states that when 
this is done, one part or component usually is found to be much larger 
than the others. (2) It provides a useful clue to aid in the detection 
of the cause of that component. The successful corrective action will 
be correlated with some element of that type of variation. 

A company wanted to know what factors had a major effect on the 
sales of their product, used in the construction of homes. Its sales 
executives honestly felt there were innumerable variables involved, but 
the major ones were undoubtedly such things as housing starts, disposable 
income, and the amount of money spent on national advertising. 

A trade association distributed monthly the combined sales figures 
of all member companies, state by state and nationally. It was a 
straight forward job to plot these components of total variation, the 
year by year, month by month, and state by state differences. The aver- 
age sales one year to the next were almost the same. Month to month 
showed a mild seasonal effect, but not large. State to state differences 
were ten to twenty times as great. 

The sales executives^ reactions to this plotting were interesting. 
While they now conceded the three factors they originally suspected 
should have shown up as year to year variation, they felt the revelation 
of this new approach could be readily explained; state to state differ- 
ences were obviously due to such things as population, climate, and in- 
dustrial activity differences « 

These could each be checked out by correlation plots. If the plot 
of sales, on the vertical scale, was influenced to a major extent by the 
suspected factor, on the horizontal axis, then the scatter of points 
about a trend line woiild be small - on the assumption that all other 
factors are varying at random while' that on the horizontal scale remains 
fixed at a value. This situation can be controlled in certain designed 
experiments, and needs to be checked or objectively considered in a case 
like the one being discussed to assess the validity of such a conclusion. 

Rather unexpectedly, plots of population, climate, and industrial 
activity versus sales each showed a wide scatter. Some other factor, 
varying at random while each of these is fixed, must be having a major 
influence on sales! 

This conclusion encouraged three weeks of plotting of other factors 
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correlated mth state, to, state differenc^^^ Finally one factor ;did show 

narrow scatter against sales, but in two, non~parallel bands, pother 
factor was interacting with the important one I Another week pflplotting 
uncovered that one also., __Naw that c^ knows how to proceed to in- 

fluence sales of its product favorably, arid most effectively. 

The third principle of imperfection applies to situations tiaving 
several causes of variatipn acting at the same time and in such ia way as 
to make a physical separation of effects from each cause yirtu^^ im- 
possible, The principle states that it is unlikely in such sittiations 
that the important causes are simultaneously at their optimum levels with 
regard to desirable results# if* they are controlled , at all. . Two devices 
are employed in the process of conducting tests to determine the facts, 
which enable management to see Vhat causes are important and what are the 
optimum levels for them. One is called and the othe# random- 
izing. (3) 

Figure 1 is of a layout or plan for an experiment to study the ef- 
fect of two factors, A (advertising coverage) and B (type of adyertising) 
on sales. A3_, A2, and A3 are three levels of coverage, say, low, medium, 
and extensive. Bi and B2 stand for two different types of advertising. 



Figure 1 ■ 

Each trial would represent a month *s sales, during which the particu- 
lar combination of coverage and type, intersecting in that particular 
square of Figure 1, would be run. Since the sales, for t^ product are 
affected, if at all, with a short or no lag time after the appearance of 
the advertisement, each trial would represent a month, spaced a-; month or 
two weeks apart. 

If the tests were run in the same sequence as the trial nuijibers, it 
would be possible for other variables that , change with time to ’^confound” 
with A and B and give an incorrect cause and. M r© Jn^hAonship . Such 

variables might be changes in products of competitors, shifts in their 
strategy, and changes in consumer tastes or income . , B^^ .Ah^w 
months are run in random sequence, say, 11, 6, 3# 10# 1# B, 9, 4# 12, 5# 
2, and 7, then all other variables changing with time will cause a lack 
of repeatability among pairs of results in the square. These dif- 

ferences within pairs will determine the size of a single statistically 
determined number for experimental or background error. 

Suppose the sales figures recorded when the test was run were; 
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h 

A2 

A3 

AVERAGES 


190 

235 

290 



210 

265 

270 

243.3 


175 

235 

240 


B 2 

165 

205 

260 

213.3 

AVERAGES 

185 

235 

265 



The differences among the average when Ai, A2 and then A3 were pres- 
ent are 50 from A^ to A2, and 30 from A2 to A3. These differences cannot 
be affected by the effect of Bx versus B2# since both B^s were equally 
represented in each of the averages for the A»s. The effect of B»s has 
been balanced out, for this part of the analysis. So the difference of 
50 and 30 can only show the effect of any real differences caused by 
changing Ai to A2 to A3 plus the chance effect of experimental error. 

Six figures contribute to the experimental error, the differences 
between pairs of results in the same square 20, 10, 30, 30, 20 and 20 
giving an average error of 21 2/3. When this figure is divided by the 
square root of the number of readings going into each average for A we 
roughly the expected contribution of the error to differences among 
the averages for the A^g, That gives us 10 5/6, not as much as the ob- 
served differences of 50 and 30. (4) 


The differences between the averages when B^ was present and when 
B2 vias present is 30. The expected contribution to this difference from 
the error is 21 2/3 divided by the square root of 6, or about B.B. The 
effect of A»s has been balanced out for this part of the analysis. 

The statistical computations for a formal analysis of variance (not 
those done here) result in a numerical value of probability that the 
error can cause the observed differences among the A averages and the B 
averages. When the probability is low, the effect of A or B is called 
significant or real; when it is high, not significant. This table of 
odds shows the interpretations usiially given to these results. 


Odds 

Less than 20 to 1 
Less than 100 to 1 
Greater than 100 to 1 
Greater than 1000 to 1 


Decision 

Not Significant 
Questionably Significant 
Significant 
Very Significant 


Read as "odds of less than 20 to 1" that the result could be caused 
by other factors (error) oftener than one time in 20; "odds of greater 
than 100 to 1” that the difference could be caused by other factors 
(error) less often than one time in 100. 

Experimental designs permit decisions, with a high /and known proba- 
bility that they are correct, as to whether real cause and effect re- 
lationships exist. Many factors can be incorporated in the same experi- 
mental design. So it is possible to detennine which factors shouldT be 
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controlled and at itfhat levels they should be kept to get the desired re- 
sults* 

“When members of management are exposed to such as these JMa^gement 
Quality Control (MQC) techniques in their own work, their use gradually 
becomes ’’second nature»%^^^ J^^ always aid good judgment so that 

better decisions are jmde in inport ant areas* 


Foot Notes: - 

(1) ’’Universals in Management Planning and Controlling”, J*. M* 
Juran, THE MANAGEMENT IMJW, NOVEMBER, 1954* 

(2) Due to L* A* Seder, the ’’Multi-Vari Chart” concept* 

(3) Due to R. A* Fisher, the concepts of design of experiments 
and analysis of variance. 

(4) This approach needed the word ’’ roughly” in the previous 
sentence became it is. purposely oversinplified to brif^g 
out more clearly the type of relationship involved. Ai^d 
we can further say, while the expected error is roughly 
10 5/6, the actual contribution of error in this experi- 
ment could have been larger* And contributions further 
away from the expected have a smaller probability of oc- 
curring* 
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QUAim CDNTflOL - ITS | 

Clair A. Peterson, Colonel, USAF ■ 

Headquarters, Air Materiel Coromand 

Most of you are of course awA^ pf the great emphasis that iias 
been placed within recent ntpnths on the subject of reliability - 'parti- 
cularly with reference to electronic equipment, which today compi^ises 
a major and vital part of our modem weapon systems* ir 

Both industry and the military services have orgaziized committees 
and task groups, concerned with the various fac^^^^^ relia- 

bility j in order to detex^ne, within their particiiLar fields of inter- 
est, ways and means of improving reliability. Among the numeroujj maga- 
zine articles pid>li8hed, and the many addresses delivered in connection 
with such committee activity, it is interesting to note the frequent 
references made to quality control, and the important part they Icknow- 
ledge it must play in any reliability program. Chfortiinately, however, 
many of these articles and addresses reveal varied and m^ed opinions 
as to the precise part quality control, as a function, should play in 
the overall reliability program. 

■ -ii . ■ 

To be sure, this function is most ^ i^ but it must bej^ remem- 

bered that there are certain boundaries within which quality control 
xnust work; since it is essentially a suppoiSli^^ r^ t hap one 

of direct responsibility. To further qualify this statement, it is 
first necessary that we understand the difference ^ 
control** as a funqtiOT and "quality** as a chaiScteristic. 1 ; 

Generally speaking, we consider quality control to be a confor- 
mance function; that is, conformance to certain quality standarnp which 
have already been established. "Quality Control,** then, or control of 
quality, is construed to mean a system of controls which will apjsuie 
that the quality of the end product will be as specified. Quality, on 
the other hand, must be expressed in terns of certain physical Character- 
istics designed to obtain mission objectives. 

Beliability, being dependent on quality, can be achieved oij^ly idien 
adequate controls are exercised oyer This means, then,: that 

the quality control program, in coordination with the engineerih^ pro- 
duction planning, and other elements, must be designed prscisely around 
the quality and the reliability requirements of the particular pQttip- 
ment under considorstion. ii 

Once the designer has finished his job, he must then look to 
quality control to take over the job of seeing that design require- 
ments are being met; and also seeing that he is kept informed 
conditions which would indicate insdeq^^^ design or of test ■re- 
quirements, or conditions idiich indicate places where certain j|iprove- 
ments could be made. 

The effect, then, that reliability will have on quality control 
is this: that quality control can no longer be an independent and 
self-sufficient fun but instead must initiate its planning in 
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conscaiance with all other planning $ that is it must develop a day-to- 
day working relationship with engineering, purchasing, production, and 
management; it must produce factual data and statistics - not only for 
its own use, but for the use of other elements of the oiganization 
concerned with reliability; it must hold a position co-equal to other 
executive positions within the organizational structure; it must staff 
its organization with talents and skills commensurate with the tech- 
nical complexities of the product; and it must maintain a progressive 
and continuing program of training, concurrent with technological ad- 
vancements - both in respect to the product and to quality control 
techniques • 

As the trend toward placing on the contractor more responsibility 
for design and reliability progresses, likewise the quality control 
responsibility increases* Quality control must team up with the engi- 
neer in the development of test programs, test apparatus, and test 
facilities* Specifications should be reviewed for adequacy, subcon- 
tracting programs and purchase documents should be reviewed, and 
necessary liaison should be established between prime and subcon- 
tractor* The quality control effort must now be extended into every 
area where quality and reliability are affected* 

Perhaps we should here consider what these areas may encon^ass, 
and also consider what Quality Control within the Air Force visualizes 
as a total program for reliability* 

So far our discussion has referred to quality control only in the 
design and production stage; however, once the desired reliability has 
been obtained, it must be maintained - or the whole effort is lost* 

Then we must recognize tlie need for a program which ccxntinues 
through the idiole life cycle of the equipment - commonly referred to 
as the ’♦cradle-to-the-grave’* concept* 

We at Headquarters AMC have already developed qiiality control 
programs in our supply and maintenance depots, and we are therefore 
in a position to introduce certain reliability assurance procedures 
in these areas* 

These procedures will no doubt stem fr^ and will be correlated 
to the reliability requirements established for the new equipment; 
utilizing the quality standards, test procedures, and acceptance 
criteria developed during the period of development and production 
of the original equipment* Through this process it should be possible 
for quality control to assure that the reliability built in during the 
procurement phase will be continued through the storage and maintenance 
phase* 


One phase which at present has not been adequately covered in the 
life cycle quality control concept is the quality of maintenance while 
the equipment is in the hands of our operating commands* In order to 
assure that the original reliability built in during manufacture is 
continued during depot storage or maintenance, it is necessary that a 
more formalized quality control program be established at the operating 
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bases# Here again it will be necessaiy to incorporate specific |2X)- 
cednres for checking reliability characteristics derived from re|uire- 
ments established for the particular equipment under consideration# 

It can be expected that future contracts for weapon systems; may 
reqxiire contractors to furnish much more comprehensive technical; to 
rnation for the operation^ maintenance , and testing procedures j related 
to the reliability requirements for the equipment they manufacture# 
This information would then be useful to quality control in developing 
the life cycle quality control program for each weapon system. ■ 
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AN OPERATIONAL STUDY ON SHIPPING TANIOIGE j: 

J* C. Dickson 

Humble Oil & Refining Company q 

Introduction I: 

Shipping large amounts of oil or oil products by tankers gives a 
refiner serious problems. The tankers do not arrive at fixed intervals 
and remove a fixed amount ^ o^^^ Instead, the time between tanl^ers 

varies and forces the refiner to build shipping tanks. These tanks are 
Insurance against delaying tankers or varying tHe products ” 

And complications set in when the demand for the product is season- 
al and the tanks used for seasonal storage are used to help out 'the 
shipping tanks. This is, of course, an advantage to the refinefy but 
finding the best amount of shipping tankage gets rough. '‘■ 

This was the problem tackled by our Operations Research te^j the 
team at first was made up of a physicist, a man familiar with e:^i sting 
tanks and lines, a man familiar with overall refinery economic s| and 
two men from an Operations Research consulting firm. || 

It is the purpose of this paper to describe how we attackecj this 
problem and the conclusions we reached. 

Description of the Problem . 

As usual with Operations Research work, the first, duty was' deciding 
what needed to be done . ; There was little doubt the problem was one of 
simply minimizing costs and that emp.loyee morale, sales policies, etc., 
did not enter into the picture. So we could separate the costs" which 
were pertinent to this problem: 

1i- ■ 

(1) Cost of delaying tankers 

(2) The operating 'cost on shipping tanks plus capital chajuges 
on these tanks 

(3) The cost of production cutbacks 

( 4 ) The cost of pimiping oil to or from seasonal storage 

(5) The capital charges on oil in. Inventory 

Next we needed to describe the physical system. Figure 1 ;is a 
rough outline of the model we used; the symbols used are defined in , 
Table I . ^ 

The demand for oil, on any day, D^, is a function of the oil ip 

tanks, planned production, and a random variahle,. This last^^M^ 

random variable, is used to represent the randomness in the . art iyal of 
tankers. The production on day i. Pi, is a function, of , the pi^ in the 
shipping tanks and the oil to be transferred to seasonal tanks,. If the 
shipping tanks are too fuH^ the production must be decreased. 

The oil transf erred. , to , sea^s^^ on, day i, Ti, depends on the 

amount of oil in the shipping tanks, the amount of oil in the seasonal 
tanks, and the day of the season. The day of the season is he,pe because 
the seasonal tanks are used for other products part of the sea'son. Once 
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these functions are defined, material balances can give us the inventory 
on each successive day and the delay time on the tankers. This is all 
we need to calculate the operating costs. Figures 2, 3^ and 4 present 
the complete functions for Tl, and D^. 

Daily Production 

Figure 2 shows five modes of production which we take into account. 
I will not try to explain all of these, for two examples should give the 
pattern. 


The first mode is Pj. = pp- In other words the production is equal 
to the average if two conditions are met: 

(1) Cr< Ipi < Cq ; which says that the inventory in the shipping 
tanks must be within certain limits, and 

(2) Ipi + Pp - Ti = F 3 which says that the planned production will 
not overflow the tanks after transferring oil to the seasonal 
tanks. 


The fifth mode is Pi = iPp 


-I'- 


which says the production is 


0=0 


the planned production up to and including day i less the actual pro- 
duction up to and including the day before. This is the right mode if 
j=^i < 

y Pj = Pp + A2J ioS,, if the production calculated by this 


iPn 


^=0 


mode is no more than some amount, Ag, over the average production. 


Daily Transfer 


Figure 3 shows the five modes of operation for the transfer. As in 
the case of Pi, only two of tiie modes will be explained. 

The first mode says Ti = Tjji^x. This is the right mode if 

(1) iFi ? C^J i.e., the inventory is above a certain limit, and 

(2) S’i ~ "^max ^ pumping T^^^gy barrel q into tanks having 

Tsi barrels in them will not make the total inventory greater 
than the allowable S'i. 

The fifth mode says Ti = 0. So no oil is transferred if 

(1 ) Cl < iRi < Cu; the shipping inventory is within certain 

limits, and 

(2) Igi S S^i; the inventory in seasonal storage is not greater 
than allowable. 

Daily Demand 


Figxire k shows the form of the dally demand for oil. Here is how 
we decided upon this. 

(1) The product was picked up by two types of tankers. The first 
type takes on its main load of some other product and uses the product 
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under study for a filler . W© csLl^ed these ’’small cargo tankers .-I” The 
second type is the one whose main ca^^ is the product under stijidy. We 
called these ’’large cargo tankers.” 

(2) Other studies on shipping systems have successfully u$ed 

Poisson distrihutipns t^ describe the frequency of tanker arrivals. Our 
records on tanker arrival looked like" t^ a Poisson distribution. 

(We later found that this had its limitations I ) 

• ^ "■ ■■■ ■ ■■ ■ ■ ■ ■ • ■■■ jj, 

(3) Some scheduling of tankers does take place. The guidjng light 

in this scheduling seemed to be the difference between actual i||:vent^ 
and planned inventories. To accoimt for the lag time in the exj^hange of 
inventory information between the ’’schedulers” and the refinery) a 
scheduling interval, was selected and the avera.ge arrival rate oj tankers 
Was changed only at this fixed interval. '! ' 

( 4 ) Only large cargo tankers are scheduled* j; 

These considerations led to the equations shown in Figure ,The 
average number of small cargo tankers arriving on any day and their 
average cargo size was known.. To calculate the demand represented by 
these tankers, we simply selected a niimber at random from a Poi^sson 
distribution to represent the npiuber of these tankers. The average of 
this distribution was equal to the average number of small cargo tankers 
arriving per day. We then sampled the distribution of cargo s^zes and 
got a size for each of these tankers. The sum of these cargoes: is the 
demand for oil by small cargoes. 4 ! : - : : 

The tankers which had large cargoes are scheduled. Sp we ::had to ^ 
have a method for deciding on the average or expected number of large 
cargo tankers .arriylng. The equation in the middle of Figure ||- is this 
adjustment. The desired shipment of oil for a short period isj; equal to 
the planned production, plus any inventory above planned, plus:' any Cut- 
backs in production that have accumulated. When divided by the average 
cargo size for the large tankers we get the expected tanker arrival rate. 
The number of tankers and their cargo sizes is selected just a.s they were 
for the small cargoes. Tbe total demand is ^t^ the Ipmall car- 
goes plus the demand of the large. i: 

■ if 4 

The term ”J” which is in the formiula for is the planned inven- 
tory in seasonal storage. This is calculated from the idea tljat the 
inventory in this storage should be reduced at. a constant rate from, the, 
first day of the season to the last day that this tankage is dyaiiable, 

I will not go into the details of selecting random sample^. 

The Analysis of the Model 

Wow that all of the fimctions had been defined, the only' job left 
was finding the best values for the volume of shipping tankag^ and the 
control limits, C^, C^, and Cx,. The nature of the model crie^ for a 
Monte Carlo solution^ This type of solution is hard to descrij.be .briefly 
but I will attempt to do so anyway. H 

In systems which include randomness or unpredictability,'’ true ana- 
lytical solutions impossible, The. Monte technique for 

solving these equations is simiiar to tte way you would decide the odds ' 
for winning at solitaire - you would play the game and see hqw often 
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you win. Of course, with a large bulky '’game” like a shipping system 
you cannot actually play very many times; so, a model is constructed 
which is analogous to the shipping system and which can be ’’played" 
rapidly. We make the assumption that what is good for the model is 
good for the system. 

We tried various values for the things we were interested in and 
used our model to estimate the operating costs. By playing the game for 
a number of seasons and averaging the operating costs, we estimate the 
average operating cost of the shipping system. The more seasons we play 
the game, the better our average. 

At first we planned to calculate the possible error in this average 
after each season and repeat the calculations until this error was re- 
duced to insignificance. It did not take long to discover that too 
many seasons would be needed. Consequently, we had to find out how to 
live with a large error or how to reduce it some other way. Actually, 
we did a little of both. 

It turned out that the large error was caused by the way we select- 
ed the number of tanker arrivals. The possibility of an extreme number 
of tankers arriving on any given day had been blocked by simply limit- 
ing the maximum possible value in our Poisson distribution for the 
tanker arrivals. On the other hand, there was no limit to the number 
of consecutive days on which no tankers arrived. The chance of a long 
run without tankers coming in was very small for a given season but 
when you are working with a sample equivalent to 40 or 50 years, the 
chance of this happening somewhere in the sample is significant. It 
happened, then, that occasionally . one of our seasons would contain a 
successive rim of nine or ten days without any large tankers arriving. 
The cost of the production cutbacks which had to follow this over- 
shadowed everything else. Please notice that this type of risk can 
occur in most Monte Carlo problems. 

We improved this a little bit by reducing the scheduling interval, 
but we still had a large error in our final cost figures. The question 
then was whether or not we could live with this error. 

A review of the entire study was made and it was found that the 
tankage for this shipping system would be changed by large increments 
to reach any optimum. In other words, 50,000 or 100,000 barrel tanks 
would be bought. A 10,000 barrel change has little meaning. Therefore, 
we didn’t need the exact value for the optimum tankage. This made the 
error easier to live with. In fact, when considering this, the ex- 
pected error of a 40- season sample was small enough to let us select 
the best tankage. 

This error did not. cause too much grief with regard to the decision 
limits either. An analysis of the possible effects of changing these 
limits showed that there would be a broad region of essentially no 
effect bounded by a region of extreme effects. For example, if Cl> the 
decision limit used for transferring oil from seasonal storage, is 
gradually raised above zero tanker waiting costs drop. As this limit 
is raised more and more it stops affecting the tanker waiting costs. 
Further, it does not show any other effect until it approaches the limit 
of the shipping tankage where the cost of production cutbacks jumps. 

All of this gives a broad area of equally good values for this decision 


310 



limit. The other decision limit^^^^ he shown to behave in a likje 
manner. 

So we foixnd that ^we cpi^d live with the large error in the Average 
operating cost^ and recommendations regarding shipping tankage ” add ' tiie 
decision limits have been presented to management. 

General Remarks About the Problem !i . 

This study had another purpose - providing us with information about 
shipping systems in general and the pitfalls in other tankage studies. 

It is my opinion that this project was successful in this respec|. We 
will never build another random tanker arrival model vjlthout li^'jLts to 
both the number of tankers arriving in a given day and the number of 
days without a tanker arrival. If this had been included ^ in Qur| model ^ 
for this study, the manpower spent in cuf 

in half. . ~ 

In future studies on shipping systems the model .wouM not , he with- 
out an ’’anticipator mechanism." We know that in the actii^al shi]^ping 
system the exact dates of tanker arrivals are known two or three days' 
in advance. Being able to predict trouble you can often preven'^' it. 

This can make a big difference in the amount of insurance you ni'ed. 

It may be hard to find the nature of the prediction and the methods of 
prevention but it is worth looking for. |! 

At one time we hoped that this model T^ould serve as a general model 
which we could adapt to any shipping system. This is- not so. " |^ature 
studies of shipping seasons will require new models; and if we &on’t 
try to make it into ^^^a model, the effort and cost of _s plying the 

problem will be le^^^^^ i; ; ^ ^ ^ 
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TABLE I 


Pi 

Ti 

IfI 

Isi 

S'l 

CUj 

^sij 

NlI 

Nsi 

Ml 

Ms 

t^L 

l^s 

^max 

^max 

Cu 

Cl 

Cr 

Al 

A2 

F 

S 

N 

r 

Ei 


definition of symbqie 

= day of season being worked 
= demand for product, day i’ 

= production of product, day i 

= transfer of product from shipping tanks to seasonal tanks dav i 
= inventory in shipping tanks, day 1 ' ^ ^ 

- inventory in seasonal tanks, day i 

= maximum ^allowable inventory in seasonal tanks^ day i 

- cargo size of the jth large tanker, day 1 

- cargo size of the Jth small tanker, day i 
= number of large tankers, day i 

= number of small tankers, day i 

- expected number of large tankers 
= expected number of small tankers 
= average cargo of large tankers 

= average cargo of small tankers 
= maximum allowable transfer rate 
= maximum production 

planned production or desired average production 
upper decision limit for production cutback 

- uPPe^’ decision limit for transfer to seasonal storage 
lower decision limit for transfer from storage 
lower decision limit for production increase 

- volume of low profit product Being produced at P,, 

= volume of highest profit production not produced at P,, 

= capacity of shipping tanks ^ 

= capacity of seasonal tanks 

: 

= a random variable 
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FIGURE 1 


THE SHIPPING SYSTEM 


Seasonal 

Tankers Capacity S 




3 «' 






riGURE 2 


Pi = Pp 
Pi = Pp - Ai 
Pi = F - iFi 

Pi = Pp + A2 
J=i-1 

Pi = IPp Pj 
5=0 


DAILY PRODUCHON, P^ 

When Cr < Ip < Cc and In + Pp - Tj ? F 
when iFi = Cc and Ifi + Pp - Ai - Ti < F 
when iFi + Pp - Tj > F 

J=i-1 

when iFi < Cr and iPp > ^ Rj + Ag + Pp 

5=0 

J=i-1 

when iPp Pj = Pp + Ag 
j=0 
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FIGURE 3 


DAILY TRANSFER. Tj 


Ti = . ISi 


Ti = ISi 
== "'^max 
Ti = 0 

S’ = S 

S' = S - Tj^a,x(^“^) 
S' = 0 

M = N - .. 3 — 

"^max 


when Ipi ^ and S ’ i , = T^ax ■*■ ^Si 

when Ipi = C'^ and Tj^^x ^ S' Igi 
or Ipi < and Isi = S* 

when iFi ^ ^Si < ‘^max 

when Ifi = and Igi > Tu^^x 
when Cl < ^Fi ^Si = 

when i $ M 
when M i S N 
when i > N 
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FIGURE 4 


DAILY DEMAMD, Dj. 


Di = ) CLij + ^ CsiJ 

J 


where 




is the srim of a sample, of size Nx,i> selected at random 


Ml = 


from the distribution shown in Figure 5* N t.j is selected at 
random from a Poisson distribution having a mean of Ml- 

J=i-1 

lyX - 1/2 F + Isi - J + (i-l)Pp - ^ Pj 
^ 




J = (i+r) — when i + r S N 
N 

J = 0 when i + r 5 N 


Ml is calcuaated only if i is an exact multiple of r. 

J 

^ Cgij is the sum of a sample, of size Ng^, selected at random from 

the distribution shown in Figure 6. Ngi is selected at random from 
a Poisson distribution having a mean of Mg. 
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TBE DIGim. COlOTTm AIR) TO ii. . 

Donald E. Hart 

General Motors Research Staff ;! 

You have all heard digital cong)uters referred to as "giant |bralns" 
or "thinking machines." I shoiild like to dispel the aura of science 
fiction which surrounds these machines hy showing In some detail;’ how we 
go about using a computer to solve a problem. I shall draw an analogy 
to a computer with which you all have some familiarity — «an ordinary desk 
calculator. 

If we had a desk calculator and wished to solve the same problem 
over and over again, we would undoubtedly equip this desk calcull^tor 
with an operator. Now, let us assume that this operator is almost a 
complete idiot, but that we have been able to teach this operator to 
recognize a limited set of written instructions, Ihese are very' simple 
Instructions, but If we write down enough of them in the right sequence, 
we are able to use this computer to solve large and complex protiems. 

If we present a sequence of these instructions to our operator, iie will 
carry them out rapidly and without error; however, if we give him a 
Instruction which is not in his repertoire, he will become confused and 
stop working. In order to show how we would get this computer tip solve 
a very simple problem, I shall go through the seven steps that Wp must 
always go through in solving any problem on a digital computer, 

I, Mathematical Formulation 
II , Mathemati cal Analy si s 
III. Programming 
IV, Coding 
V, Checkout 

VI, Production Computation 
VII, Evaluation of Resixlts 

THE PROBLEM 

Given: A rectangle with area = A sq, in. 

One side is (n) Inches longer than the other. 

Find: The lengths of the sides. 


X + n 


A 


X 


STEP I - MATHEMATICAL FORMPDATION 

The problem must be described in mathematical language, 

x(x + n) = A 
2 

X + nx - A = 0 
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This is recognized to he of the form of a quadratic. Since a 
certain amount of effort is to he expended in preparing this problem 
for computer solution, it is desirable to set up a routine which will 
solve any quadratic equation; 

2 

ax + bx + c ss 0 

Where, for our special case: 

a = 1 
b = n 
c = -A 

STEP II - MATHEMATICAL ANALYSIS 

This step is necessary in order to reduce the mathematical formulas 
to a numerical form suitable for machine solution. 

For the qixadratic, 

2 

ax + bx + c « 0 

if numerical values for a, b, and c are given, the values of x cannot be 
found directly. 

If the quadratic can be manipulated into the form, 

2 2 2 

X + 2rx + r = (x + r) 

the square root can be extracted leaving only the first power of x. 

When this is done, the following familiar expressions are found. 

X -b 4- ^lb^ - W 

1 2a 

V -b * \lb^ ka^c 

2 S 

By plugging in numerical values of a, b, and c, it is possible to 
find x^ and x^. Unfortunately, a conrputer doesn^t have "plug into" as 
one of its instructions, 

STEP III - PROGRAMMING 


Programming is the development of the complete logical flow of the 
problem solution as follows: 

Given: a, b, c 

nad: x^, Xg 

Restriction: Interested only in real roots. 
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S!EEP IV - CODING 


It is now possible to write down, in the specialized language of 
the computer, the detailed sequence of instructions for solving the 
problem. We are given two sheets of paper on which the lines are num- 
bered. Shown on the right are the Data Sheet and the Instruction Sheet. 

Refer to the Data Sheet. At the beginning of a problem, numerical 
values of a, b, and c are recorded on lines 100-102. At the completion 
of the problem, the values of and will be recorded on lines IO3 
and 104. Intermediate results, as they are developed, will be recorded 
sequentially starting on line IO5. 

The columns on the Instruction Sheet are as follows: 

Column (2) - Where (line number) to get the first number. 

Column (4) - Where to get the second number. 

Column (3) - What operation to perform on these numbers. 

Column W) - Where to put the result of this operation. 

Column (6) - Reference information for the coder. 

The numbers in brackets in the Explanation Column refer to the corre- 
sponding blocks in the Flow Diagram, Consider first Block [2], The 
instruction on line OO3 says, "Take a number from line 100 (a), multiply 
it by a number from line 102 (c), and store the result (ac) on line 105*" 
The instructions on lines 004-006 are executed sequentially in a similar 
fashion to complete the con^tation of (b^ - 4ac). 

The instruction on line 007 asks, "Is the number on line 108 nega- 
tive?” If the answer is "no," go on to the next instruction in the 
sequence (008). If the answer is "yes,” the next instruction to be 
executed is located on line 018. 

The instructions on lines 008-014 are carried out in sequence to 
complete Block [4] of the Flow Diagram. This completes the arithmetic 
portion of the computation. 

Input - Block [1] 

Assume that our computer can read standard IBM punch cards. The 
instruction on line 000 says, "Read one card and record on line 100 the 
infoimation punched in this card." Three cards are read in sequence in 
order to get the numerical values of a, b, and c into the computer. 

Output - Block [3] 

The instruction on line OI5 says, "Print the number located on 
line 103 (x^)." 

The instruction on line 017 informs the computer that the problem 
has been completed. 

The instructions numbered OOO-OI8 and the three numerical constants 
on lines 020-022 completely describe this problem to the computer. 

These nineteen instructions and three constants constitute what is known 
as the computer PROGRAM. 
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DATA SHEET 


(1) 

( 2 ) 

( 3 ) : 1 

Line Nmber 

Contents 

E^lanati^i^ 

100 

101 

102 


Input Data 

103 

104 


Final AnaMrs 

105 

ac 


106 

4ac 


107 

u 


108 

- 4ac 


Intermediate 

109 

- 4ac 

Results - 

no 

-b 


111 

-b +^b^ - 4ac 


112 

-b -'Ib^ - 4ac 


113 

2a 



020 

021 

022 


Numfiricajl 

Constants 


INSTRUCTION SHEET 



:i] 

[ 2 ] 

[ 3 ] 

W 

[ 5 ] 

[ 6 ] 
[ 7 ] 
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3!EEP Y CHECKOUT 


Checkout is necessary in order to assure the correctness of the 
CODING, Ihis is done hy presenting to the coB5)uter a test problem for 
which we know the answers. 

First, the program must be stored in the memory of the computer. 

One card is punched for each instruction. These cards contain the 
information from Columns (l)-(5) of the Instruction Sheet, There will 
be nineteen instruction cards. Similarly, the numerical constants from 
lines 020-022 are punched into three cards from Columns (l) and (2) of 
the Data Sheet, These 19 + 3 = 22 cards constitute the H^OGRAM DECK. 

If this program deck is inserted into the card reader of the com- 
puter and the LOAD button is pressed, the computer reads these cards in 
sequence and stores the information from each card into a memory loca- 
tion corresponding to the line number punched in the cards. Thus, the 
instruction from line OO3 of the Instiuction Sheet is stored into memory 
cell 003 in the computer, etc. The number associated with each memory 
cell is called its ADDRESS. 

Three cards containing numerical values of a, b, and c are placed 
into the card reader. The computer is told that the first instruction 
is in memory cell 000 and the START button is pressed. The computer 
executes the first instruction which causes the contents of the first 
data card to be stored in memory cell 100. It then gets the next in- 
struction from memory cell 001 and continues in sequence until the pro- 
blem is completed. 

Test Problem 

a = 1, b = 6, c = -16 

= 2 ., Xg = -8 

Corrections must be made in the program until the computer produces 
the correct results. Another test must also be made to verify that the 
computer operates correctly when (b^ - 4ac) is negative. 

At this stage in a larger problem checks would also be made of the 
correctness of the Flow Diagram, the accuracy of any numerical approxi- 
mations from STEP II, and the adequacy of the initial mathematical 
approximation to physical reality developed in STEP I. 

STEP VI - PROmCTION COMPUTATION 

A digital computer is a general purpose device which is potentially 
capable of doing almost anything. Until it receives a set of instruc- 
tions, however, it is actually capable of doing almost nothing. The 
process of reading a set of instructions into its memory converts a 
general purpose computer into a special purpose device which is immedi- 
ately available to solve a particular problem— in this case a quadratic 
equation. 
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Below is shown the flow diagram of a typical production cbi|putation. 



Special Pui^ose 
Computer 


A computer would never be used to solve one quadratic at a 'tirae . 

It would be used if there were m sets of input data/ ihe origir^ 
program can be made to do this by replacing the SIOP ins true tibi::|^( line 
017) with the instruction: GO TO (OOO) which tells the computeii- to get 
its next instruction from line 000/ This program will continue ;|bo solve 
quadratics until it rims out of data cards. I 


With the IBM 7^^ Computer, we can solve 100 quadratic equaiiions in 
considerably less than one minute. 1i 


STEP YU- EVALUATim^ 


For the original problem: 

a=l, b=n=6 in., -A = -I6 sq. in. 

® 2, Xj^ + n 8 
x^ ~ -8, n = -2 


Both sets of results are mathematically correct solutions to the quad- 
ratic. Only the first is a reasonable answer to the physical problem. 

The results of all machine computation must be viewed in th| light 
of the physical situation which is being studied. Ij 


With this simple example, X have tried to demonstrate the i|iportant 
aspects of a digital, comeputer . First, with a limited set of simple 
instructions, it is possible to solve large and coiiiplex problems i-a 
large problem may require several thousand machine instructions.!; Second, 
the comeputer is able to choose between two courses of action whe^e this 
choice may be based on the results of previous calculations. By^‘ com- 
pounding these two-way choices, it is possible for the computer to ma^e 
complex decisions. A third factor is the computer's tremendous |peed; 
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a lOk, for example, carries out up to 40^000 instructions per second. 
The combination of these three factors gives the computer a high degree 
of flexibility. A digital computer is able to solve almost any problem 
which can be expressed mathematically. A digital computer is also 
extremely adaptable — it can be ready to solve a new problem in the 
length of time that it takes to read a new set of instructions into its 
memory from punched cards or magnetic tape. 

COMPUTER APPLICATIONS 


To show how a digital computer is used and to demonstrate the speed 
and flexibility, a few problems will be briefly described. There are 
two major classes of computer problems— those which can be solved by 
hand and those which cannot. 

I. Problems which can be solved by hand. 

A. Data Reduction - In the case of engine tests or experimental 
stress analysis, for example, simple calculations must be per- 
fonned before the results of the test are usable. When done by 
hand, often only enough calcialatlons are performed in order to 
plan the next set of tests. A computer on the other hand always 
carries out a complete set of calcxlLatipns rapidly and accurately. 

B. Component Design - Component design most often consists of 
carrying out calculations which evaluate the performance of a 
proposed component configuration. 

In the case of a heat exchanger to be produced in large volumes, 
the objective is to design a unit which has satisfactory per- 
formance and which can be produced at a minimum cost. Both 
performance and production cost can be determined from the 
several Independent variables. In one instance several thousand 
configurations were evaluated and the best combination selected. 
So many combinations were evaluated that the engineers were 
confident that they had arrived at an optimum design. 

In the case of gear design, we now have a computer program 
which, without human intervention, modifies the geometry of the 
mating gears until an optimum is arrived at. A pair of matching 
gears can be designed in less than five minutes of computer 
time. 

II. Problems which cannot be solved by hand. 

In the problems just described, relatively simple computations 
were repeated many, many times. If done by hand, the job could be 
done more rapidly by carrying out several computations in parallel. 
In the analysis of complex engineering systems, however, such a 
large number of calculations inust be performed sequentially that it 
would not be feasible to complete a single set of calculations by 
hand. 

An example is the analysis of a vehicular gas turbine engine. An 
engine is made up of several interacting components. Even though 
engineers may be expert in the design of each of the components 
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which a gas turbine engine, it is not possible to pfedlci 

how an engine will perform when a psirticular set of components are 
put together. Ilhe usual process is to binlld an engine, test it, 
modify it, retest it, etc., until a suitably co^binatiQ^^^^ 
achieyed, This is both, expensive and tiine consuming. We have 
prepared a computer program which will completely determine 'the 
performance of a proposed engine in three minutes. G3ie sam| calcu- 
lations would l^e several ;! 

In the d^yelopment of the engine for the Firebird II# the computer 
was used to evaluate more t]^n ^ designs within the 

space of a few months . As a result, the development of a new 
engine was completed rapidly and the physiceuL engine performed 
according to specifications. The use of a computer resuite|L in a 
large saving in elapsed time, and permitted engineers to le^n 
rapidly about a new field. j| 

TBE ROLF OF THE OT QUALITY COITOOL 

Quality control necessitates the gathering of vast amounts Of data. 
Some of this data is usabl^^^ but most of it must.be 

processed in some manner. Because of the diff^ jin 

processing this data, much of the information contained in the dp .is 
never extracted, and put to use- Much of it resides, untouched, in long 
rows of filing cabinets. 

With a digital computer, it is now possible to subject this; data to 
standard statistical tests. This can be done w^^^^ l®^Se exjpenditui’e 

of either tiioe or money, since each computer instailation has a pumber, 
of flexible subroutines available which can be used by the statistician. 

There are programs which calculate sample statistics such a;^ mean, 
variance, standard deviation, correlation coefficient, higher molbents, 
etc. There are routines which provide a least squares curve fit, for a 
set of data points. There are routines for more complex analyses such 
as multiple correlation and regression, multivariate analysis, factor 
analysis, and linear programming. With these routines, a great ideal can 
be learned from data exists. In the foundry, for '^ample, 

studies can be made to determine wMch variabljes, and 

of equal interest, which are the unimportant variables, and what; is the 
relationship between these variables and the end product. li 

One deterrent tp the inmediate use^^^^^^^p^^^ computer is the fadt that 
source data is not in a form suitable for mechanical processing.-^ Future 
tests should be planned with a computer in mind. Data should >4' taken 
in a form for easy conversion to punch cards so that all further pro- 
cessing on this data pan be carriM. put il 

The digital computer is perhaps the most useful tool available to 
the statistician and quality control analyst. It is a tool whic|h many 
of you can use now. There are several problem areas in which a | 'computer 
becomes a necessity. 

One such area is the design and manufacture of complex sysiemis. 

Like the gas turbine engine whose performance depends on its inleractli^ 
components, so control limits can be adequately specified only if their 
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affect on the over -all system Is known* The affect of coarponent vari- 
ation can be tested In advance using a mathematical model of the com- 
plete system. 

Machine tools are now available which operate automatically under 
the control of magnetic tape. A digital computer is used to prepare 
this control tape from dimensions on drawings. When these machines 
are used for volume production, it will be necessary to build quality 
control into the computer program. 

I am sure that you will find your future with computers both inter- 
esting and rewarding. 
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QUALm COlffKOL AND KlODUC^pN OT ;; 

Ralph D, Humphries 
Cessna Aircraft Company 

An outstandiiig discovery has been made in mpdeiTi industiiy* n Busina 
and industry alike are turning to quality control for product ion-; effi- 
ciency • The results of quality control and production efficiency are 
synonomous# 

The object of any company is to produce a product or a service, to 
supply a ready demand or a created den^nd* It must l»ve value and/or 
customer appeal# The characteristics associated with the product w 
service must possess quality# Quality is a broad term# We nomally 
think of the quality of a completed product, but in order to deyaXop, 
produce and deliver successfully, we must maintain some form of ^Quality- 
control of all operations# This is a relatively new concept# A,' few 
years ago production efficiency was considered to be a high rate of pro- 
ductivity at a low cost* A high rata and low cost is still becojining 
more important - but another very influencing variable has entered the 
picttire, ” Quality#” 

I^oductipn efficiency can not only be measured by the speed and 
cost of productivity# The production results must be meas^ 
cost and quality of the product must be properly balanced# ToM^lanoe 
these three factors, a different qviality must be considered - tl^ qual- 
ity of factors responsible for the cost, the productive speed ai^ the 
quality of the product# The many detail thoughts and actions, respon- 
sible for the <a:eation of a product, must possess a degree of quality# 

There are two important aspects of the teimi Quality Control# 

1# If we use the term as a noun, we are referring to a demrtment 
or a method# To me, this seems to be the most common ^age# 

The department is responsible for seeing that a satisfactory 
product is delivered to the customer# Frequently, the::depart- 
raent has little or no control over how the product is "Iq be 
produced# Their function is to separate the good i^om^the bad# 
If the pile of bad is too big, it is time fpr a review;: of the 
specifications or the method of Inspection# ii 

2# If we use the term as a verb, it becomes a part of any" act oor 
operation# All phases of operations require some stanjkrd of 
quality. Ihgineering, Hanning, Tooling, Ifenufacturing, In- 
spection, Accounting, Sales and all related detail I»pbr work 
must possess quality# The control of such quality mus|; be 
planned# It must be premeditated or become a basic philosophy 
of everyone involved# |i v 

Both aspects of quality control are noimially required; however, the 
more completely the planning and performance are controlled, t% more 
inspection can be reduced# 

Quality must be a basic ingredient built into a product or a serv- 
ice# It is not a frill or a mere surface characteristic# We 
just spray paint it on or inspect it into a product or service,: Quality 
is a basic ingredient for which the customer pays, expects, and deserves. 
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Employees should imderstand which quality standards they are expect- 
ed to meet and v/hy close adherence to quality standards is so important 
in maintaining customer acceptance and good will* 

The concept of quality contx^ol is largely determined by the manage- 
ment attitude* The employees are motivated to a great extent by the 
environment, the indoctrination, and individual supervision within the 
organization* Management and employees who have the quality-mindedness 
need a guiding hand* They need signs to show the way* 

We at Cessna feel that the communication between inspection, manage- 
ment and the quality producing departments or employees is very impor- 
tant* The communication systems and procedures must be simple, econom- 
ical, and efficient* 

To illustrate how quality control can influence production efficien- 
cy, let us review a few examples* 

In Figure 1, the shop routing cai^ reflects the emphasis placed on 
the crew chief* s responsibilities* Each crew chief is assigned a stamp 
indicating the department, shift and section number* Each operation is 
stamped off before it is moved to the next section* 



Figure 1 
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In Figure 2, we 3mve developed an inspection procedure cardjused by 
the detail inspector as a guide for sampling and inspection instruction,. 
It is also used as a file record for all 03?ders receive This fom is 
versatile so that it may be used in all departments • Accumulate^ in- 
formation can be summarized on the card at any time* However, we have 
found that an easier to summarize the results is through I *3 JM* tab- 
ulation* 

■ ii 

■ jj... .• 

• ■jf • 



Figure 2 (front) 


331 







REM-bkS 




LOT NO, 

1 





2 



* ' 


3 





4 






5 




6 





7 




, , , V.. : .... . 

8 





9 
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Figure 2 (back) 



DATE 

hZ-S7 

SOWCB CODE NO. 

iZ 


ONOER NUMBER 

^77^3 285984 

(lOOllOO 

1 t 3 4 1 1 

UNIT MCASunC 

R«RT NUMBER 

MATERUL CODE 

OTV. IN lot 

S, SIZE 

o 1 n 1 1 1 

7 t. 

_Oe^35oo-3 

VtelD-Assy 

/2 

/z 

S 22222 

MODEL Ma 

OUANTtTV RCMONK 

REWORK CODE ^ 

OTr. rejected 

REJECT CODE 

<333333 






244444 

3/0 

3 

2. 

/ 

7 

^53 5SS 

4*tRIC*TI0N SECT. 

FORWARD 19 

INFP. STALO number 

eOUOHT BY INSPECTION 


-666666 

^-<i) , 

34 

/O9 



777777 


iiiALi&»e-/srr of -^3 Bnjfr 

PARTS INCOMPLETE 


6 8 8 8 

9 9 9 9 9 

REASON FOR RE,/CCT|OI 

l/x-^ouuPSBTS'fieAh 0.S. 



1 2 i 4 S 1 

FORM 4SSS 1 

IlM 639945 j 


Figure 3 


Figure 3, the card, is the most versatile form used. For 

each oi^er or lot of paarbs inspected, a card is filled out v/ith the in- 
fonnation necessary to tabulate a summary as required* This card is 
developed for use in any department of production. Code numbers are 
used to identify vendors, shop discrepancies, materials, etc. In devel- 
oping a code, it is advisable to coordinate with all other departments 
which may use the same code. For example, the vendor or source code is 
used by Purchasing, Accounting, and Inspection, The rejection code 
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should be one to use and to interpret • In a qualify 

minded plant, the supervision usually is aware of the errors* T|ey may 
employ various ways of keeping informed of the mistakes beirig ma^« In 
our shops, the foreman who is responsible for all production in fach 
department reqtiests tlu^ he be allowed to sign all rejection tags and 
rework ozders* due to the Jumble and variety of discrepahcies 
throughout the day, he needs a tally or recap over a period of time to 
determine how mny like par^^^ are being Ejected 

and in what area the greatest degree of corrective action is neeled* It 
is for this purpose that a code is developed - one that reduceB humerpus 
detail ohampterittics^^^^l^^ a few broad-tem^^ For exam- 
ple, see Code Designations# J: " 



1# Wron/s Raw Material ; type or thickness; tensile strength and i 
ch emi Q y sis un s at i s f ac tory ; no cert Ifi cation; certification 
not available; blisters; flaws* ii 

plmenslonal Error : too larr.e or short; too wide or narrow; too 
thick or thin; too deep or shallow; oversize pr undersize ^ 

■3* Forming Error ; iiilsformed flanges; formed baclwards; joggled 
virong; dimpled wrong* 4 

1^* Prilling and Reaming Error ; but of line; misaligned; oversize; ' 
undersize; rough; elongated; tapered holes omitted; double drilled; ■! 
iriil runs; drill mrks; drilled in 

5* Countersinks and Spot Faces ? too deep or shall pw; elongated* 
rough surface ; cocked ; coTinter sunk or spot faced in error, Jl 

6, Machining Error : undercut; cuts not parallel; off in concentricity; 
not per pehdleuiar ; finish rou^ or wavy, 

7* Threads : wro^ typo; rough; out tolerance; not concentric; tapoi^ed; 
threaded in error* 

8, Welding and Bratiy : wrong type weld or braze; operation in err^r; 
insufficient penetration ; pin holes and flaws; undercuts and burnt: j; 
jriateriai* 

9, Protective Treatment ! defective plating; anodize; irldite; pain^; 

primer; unprotected; operation in. error* ii 

10* Corroded : pitted; porous; cavities; rusted; stained* 

11* ^peratldns ! missed; reversed; wrong; incomplete, 

12, frlT^ed r"" rou^ trim; cutouts in wroriR location; undersize and : 
oversize;T trimmed in error, 

13* Oil Canned : buckled; bowed; twisted, 

lu* Matefiaf^ondition ; scratches; rough or wavy surface; torn; 'dent'O^^J 
cracked ; scribe marksT handling damage; blisters; de laminations; wori*t 
harden; stains; proof load low, 

1^* Heat Treat and Age Harden : operation incomplete; not v;ithin speicifica- 
tlonf iieab treats too many times; no test coupons; operation in errjbr, 

16, Contour ; wrong contour; under; over; wavy, jj 

17, Ideht 1 f i c at 1 on : wrong number; number poorly applied; wrong methpd 

of identificatioTi; .Identification obliterated; damaged by identlfioatloh, 

18, Rivets ; bad; mlssihg; wrong pattern; wrong size or type; too raahy; 
incomplete; not in shear, 

19* Assembled ; wrong per specification; parts missing; improperly ;; 
located; out line; with wrong bolts, screws, nuts, and bearings; defective 
staking; omitted parts; failed functional test, !j 

20* Riveting Damage ; set marks; bar marks; dings; gouges, ^ ^ 

21, iSad Repair ; vinauthori zed repair; cannot be or was- not repaired ^jier 

disposition, I; 

22, Electrical Error ; damaged wire instrum.ents will not. 

operate; burnt out in test; not per specification; not properly in- ! 
sulated and installed, !i 

23* Kisfite ; tight assembly; overlaps of tolerances; gaps; misaligned; 
bad appearance; ruined in trying to assemble, 

2b., Planning Operation ; left put operation; In wrong sequence; different 
than specification; not made for correct aerial t^ ot*dered, 

25 , Engineering Error ; drafting error; canhot be ass.embled; will not 
function; failed under load; cannot be made per specification; redesigned, 
26* Tooling Error ; inadequate tools; no tools available; tools in 
error; parts made by tooling department; tools not per specif Icatioh, 

27, P\Ar chasing ; purchased wrong parts; error on purchase order; purchased 
from Unapproved vendor, 

28, Inspection ; bought parts in error; ruined the parts by inspection, 

29* Handling ; delivered to wrong place; bypassed departments; damaged 
in transit; not properly protected in transit; Improperly stacked, - 
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Figure 4 


To keep the productive shop informed on the quality efficiency, a 
chart is located in each department section* A section is a designated 
area supervised by a crew chief* The chart is plotted daily from the 
results recorded on the I,B*M* cards* The chart reflects the percentage 
of rework and rejection found by inspection* See Figure 4* 

To encourage corrections by the production departments, we develop* 
ed a shop scrap tag* This tag is used only by the shop personnel to 
identify material which they know is defective and do not wish to present 
to inspection* The items they reject are not entered in the tabulated 
report or charted with the other inspection rejections* They are accu- 
mulated with other scrap items in Salvage* In this way a quality incen- 
tive is created - a desire to check their work more closely* 

Once a month all cards from each department are tabulated into two 
reports* 
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Om tabulation shows the total parts presented to inspectioiji, total 
parts rejected, quantity of lots presented and quantity of lots Rejected 
on each part number in a department or from a vendor* TMs is accumula- 
tive month to month for six !! 


INSPECTION DATA 

ACCUMULATED REPORT H 

' : • r.; - ■:- i> 





EOTAt OUANTnv 0» PAIT«' ' ^ 

PtIltMTtB TO IHWftllON 


KXIAL MKlOn 





Period lat thru 3rd 















1955 








0300106-30 



4 








1. • 





0310110 



-.J 

BIHBIII 



22 

031012a.- 3 


252 

- 2 

2L- 



22 

0310ia6 

116 

24 


1 ; 



22 

0310l36-a 

7 



: 



22 

0310295 

1266 


2 

a 



22 

0310296 

1146 


k 




22 

0310419 

10 


, 1 




22 

0341109-1 

220 

4 

11 

2- i, 



22 

0411579-5 

469 


Z ^ 




"V 






^ ' 


V. 







22 06ll2000-l^'^^ 


0042000-13 


0042000-30 


0042000-37 

1003 

00522 : 56-15 


0061100-5 


0061300-6 


1050107 

ML 


700320 


Figure 5 

A second tabulation shows disposition of all defective lots, list- 
ing for each depairtment or vendor the date, quantity rejected, reason 
for rejection, quantity returned for rework and son for rewotk for 
each part number* See Figure 6* 
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Figure 6 


,.L I ..1. 


Charts are sent to supeirvision and management monthly showing the 
trend in rework, rejection, scrap and quality efficiency* See Figures 7, 
8, and 9« 
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The effectiyeness of the system used and how much improvement is 
required is also 20vei*ned by applying the same method to the finj^^sl^d 
and delivered product* ir 

i: 

In Figure 10 the chart in fii:^! assembly rei’lects the condiij’ion 
reported by final inspection* The total number of squawks is req|orded 
for each, airplane* The chart, is located .qn.,^.., the.,, 

office where" everyone cSdn SOe the department's performance recorq* The' 
inspectors fill out an I*B*M* card shovm in Figure 3 on all rejected 
parts* The information is anal^ed to determine the cause for rejection 
and to make the necessary corrective action# 



Figure 10 I; 

ij' . ■ 

The final acceptance of the airplane is made by the test pilot * 

The pilots reports on all airplanes are summariaed monthly to determine 
the area and importance of the re-occurring squawks* In Figure; 11, th© 
chart indicates in wlmt area ^^ t^^ corrective a cfion 

should be placed* 
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Figure 11 

Customer reports are summarized to determine the characteristics 
found unsatisfactory after delivery. In Figure 12, the chart shows the 
items found most frequently in the reports. By comparing the charts, a 
much more realistic decision can he made on our quality index. 
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IBBBBBBBBiBBBBBBBB BBBBBBB 

(iBBBiaBBBaBBBiBBBBBiBBBBBBal 

l-SSaliiKBkSiSSgggg: 


Fig\jre 12 

At this pointy we have developed a chain of conunmicatiohl^^^^b^^ 
the product producing departments and the consumer* jf 

We see what we Have done* 

We see where we a|*e going* !' 

We see where we can make our best improvements* 


341 






For production efficiency, we must control the most important fac- 
tor we have to sell, a "quality product" - one that creates a desire to 
own, to adxdre and to use. 

If we have the desired quality in all production operations, we 
have the desired production efficiency. 
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SOME USEFUL NONPARAJyETO^ TESTS jj 

Fred A, Beeler I 

Western Michigan University || 

■it 

It is the aim ^qf this paper to discuss three nonparametric Sig- 
nificance tests and show how they can be of use to persorihel In ^he 
field of Quality Control* !: 

In many of the tests of significance used, m of sji^atis- 

tics we assume that the popul^ has some definite form, Freqiiently 
we assume the norri^l distribution and we estiniate or test hypothjeses 
about the mean and variance. For example when use is made of th,^ 
Student-Fisher t it is assumed that the sample is random and is jjrawn 
from a normal universe. The mean and standard deviation ^of a ippial 
population are called parameters of the distribution. The estimation 
or testing hypotheses concerning these parameters of a population are 
called parametric statistics. ^ |! 

In the last few years advances have been new test 

statistics which will conripare two distributions without specifying the 
form of the distribution. These methods .are called nonparametric 
statistics or distribution free statistic^. ' 15 ie...only assumption^ that 
is needed for most of the nonparametric tests is that the frequdhcy 
function be continuous. The best Icriown and probably the most useful of 
the nonparametric techniques are the X^and the binoTnial. tests. ;; Since 
these are well known no mqre^ mention wi^^ of %hem^here. 'j 

Before we take up the examples illustrating the use of some' non- 
parametric methods^ wise to reconsider the idea of measurement 

and also to define what is meant by the efficiency of a significance ^ 

test. ' " “ l! ' ' 

Measurement Tliere are fou^^ of measurgment: they are the 

nominal (classificatory), ordinal (ranking), interval, and ratid 
scales (1). I; 

1, Nominal or classificatory scale . This is measurement |t its 
weakest level of existence when numbers or other symbols are 
used simply to classify an object, person or characteristic. 

■ .. il. . . 

Examples: Classifying paper by its color. 4 

Classifying automobiles by makes. 

2. Ordinal or ranking scale . It may be that the objects i^f a 

category in the homi'm stand, in some . Mnd . of re!|.at ion- 

ship that may be designated by the carat (>) which means 
greater than, is preferred to, is higher than, is more; diffi- 
cult than, etc. 

Examples: Sergeant > corporal > private. 

Scores obtained on aptitude and ability tes|ts,* 

"^^CVery few' 'ability''‘’'teit'’'“'s'c6reT''^^^ 

measurement. Who can justify that a score of $0 is twice as gc^od as 40? 
Who can justify that the increase in ability to increase a scope from 
40 to 50 is the same as the increase from 90 to 100? If 
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3. Interval scale . When a scale has all the characteristics of 
an ordinal scale and in addition the DISTANCE between any two 
numbers on the scale are of known size, then the measurement 
is considerably stronger than that of the ordinal scale. In 
this sort of measurement, the ratio of any two intervals is 
independent of the unit of measurement and the zero point. 

Examples: Temperature (Fahrenheit and Centigrade) 

Gauge pressure 

Excess above 3-450 in, in the diameter of a bearing, 
given in .001 in. 

4* Ratio Scale . When an interval scale has a true zero then 
we have a ratio scale. 

Examples : Temperature ( absolute ) 

Distances (starting from zero) 

Weight 

Cost of an item. 

In the fields of physical science the interval and ratio scales are 
usually used. In the behavioral sciences the nominal and ordinal scales 
are usually used. 

In the selection of a significance test a person must select a test 
that is appropriate to the level of measurement. For data meastired in 
the nominal and ordinal scales one usually uses a nonparametric test as 
there are few parametric tests avrdlable. For data measured in the 
interval or ratio scales the parametric methods should be used if the 
assumptions of the parametric statistical model are tenable. If one uses 
a nonparametric test when a parametric test could be applied, then the 
parametric test is usually more efficient. For example, if a non- 
parametric test is S0% efficient, one means that if a sample of 100 is 
used in the nonparametric test to reach a decision then a sample of only 
BO would be needed by the parametric test to reach a decision. 

In the past few years a number of nonparametric tests have been 
developed ^ut unfortunately they have been published in various journals 
and sometimes in a highly technical form making them almost inaccessible 
to many people working in Quality Control. This disadvantage has to a 
large degree been overcome by a book published by the McGraw-Hill Book 
Company this last fall. It is a textbook by Sidney Siegel called 
"Nonparametric Statistics for the Behavioral Sciences." While this book 
was written for people working in the behavioral sciences, it is the 
first book on the subject and the cauthor does a creditable job in 
presenting the various tests in non-math emati cal language. There are 
tables in the back of the book to go with each test. Also some of the 
newer textbooks devote some space to nonparametric statistics. Some 
of these books are listed in the references. 

The three nonparametric tests that will be discussed are: 

1. The sign test, 

2. The Wilcoxon matched-pairs signed-rank test, 

3. The corner test of association. 
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THE SIGN TEST 

■ ■ ■■ 

To explain this test let us consider the in table 1. 

Here we have two deterTninatipns of the chlorine demand on each e|[ .1-1 
lots of paper pulp^ one determination is niade by the vandor and |!he 

other by the consumer. ]| 

■ ■ 

■■■;TABIE I . . . , . I;- ■ 


CHLORINE demand MADE BY 

(standard test) 


Lot 

Vendor analysis 

Consumers analysis 

d » Xv -|;Xc 


V 

C 

ij 

it 

1 

3.5 

3.7 

2 

5.5 

4.1 

+ !! ' 

3 

5.4 

3.8 

■ + IK- 

4 

4.6 

4.1 

5 

4.9 

3.8 


6 

5.6 

4.0 

+ . • 1 ■■ 

1 

4.0 

3.8 


6 

4.9 

4.2 

+ ■' 'll '' 

9 

4.9 

3.9 

+ il 

10 

4.5 

4.2 

+ ■ ' 

11 

3.6 

3.6 

0 


The hypothesis that we want to test npyr is that the mediaii |pf,,t.he, , 
differences of the am^^ is zero. To make this test determine the , 
sign of d « Xv - Xq, i.e. from the vendors determination subtraqj, the 
consumers determination an whether this difference :1s 

positive or negative. These signs are given in the last column 'pf 
table I. Any difference that is Mrp from the test. :j 

When the hsrpothesis that the median of the differences is |ero is 
true then one wpuli e about as many positive differences a^ 

negative. Whenever there are top many positi^ (negative) diffprenoes 
one doubts that the hypothesis is true, ji 

In our example there are 10 differences that are 
N«10. There are 9 plus and 1 negative signs. The probability of 
obtaining 9 or more plus signs or 9 or more negative signs is 0^^022 . 
Tables giving the probabilities for this test (1,2,3) . 

This is exactly the same problem as tossing 10 coins and asking what is 
the probability of getting 9 or more heads or 9 or more tails in a 
single toss. At the 5 % level of significance we will, reject the hypoth- 
esis; that we will conclude that the vendors and consumers detepninations 
do not agree. However at the 1^ level of significance one must, accept 
the hypothesis since we could not re^ ^t. 

ji • 

The efficiency of the sign test (2) when compared to two normal 
distributions with a common variance is about 96 % for samples of 6 
and decreases to about 70^ for samples of size 20 and gradually' 
decreases to about 63 % for very large samples, 

In this example' we call the two chlprine^^^^^^^^^ matched |amples 

since they are made , on the same Ipt of pulp. There is variation , in the 
chlorine demand for the different lots hut by making two determinations 
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on the same lot and subtracting them when this variation between lots 
does not apnear. All that is needed in the way of measurement for this 
test is a partially ordered ordinal scale. 

This test is most useful when v;e have 

1. Measurements on two things to be compared, 

2. Each of the measurements of the pair are made under similar 
conditions, 

3. The different pairs were made imder different conditions. 
WILCOXON RATCHED-PAIHS SIGNED-RANKS TEST 

This test is similar to the sign test except that now we will make 
use of the magnitude of the differences obtained from the matched pairs. 
Of course in this case one needs a more refined category of measurement. 
This Wilcoxon test requires ordinal measurements not only within pairs 
as required for the sign test but also the differences between pairs. 
While this test is more efficient than the sign test it also requires 
more in the way of measurement. This Wilcoxon matched- pairs signed- 
ranks test is about 95^ efficient as compared to the Student-Fisher 
t test. Of course this implies that the category of measurement is at 
least an interval scale and that all of the assumptions about normality 
must be satisfied in order to compare this test to a t test. If our 
category of measurement is only in the ordinal scale then the t test 
cannot be used as it does not exist for this type of measurement. 

To illustrate the details of performing this test let us again 
consider the same data used for the sign test, 

TABLE II 


CHLORINE DEMAND ^DE BY VENDOR AND CONSUMER 
(standard test) 



Vendors 

Consumers 


Rankj d| 

Positive 

Negative 

Lot 

analysi s 

V 

analysis 

C 

d=Xv-Xc 

Signed rank 

Signed rar 

1 

3.5 

3.7 

-.2 

2.5 


-2.5 

2 

5.5 

4.1 

1.4 

9 

9 


3 

5.4 

3.8 

1.6 

10.5 

10.5 


4 

4.6 

4.1 

.5 

5 

5 


5 

4.9 

3.8 

1.1 

a 

8 


6 

5.6 

4.0 

1,6 

10.5 

10.5 


7 

4.0 

3,8 

,2 

2.5 

2.5 


8 

4.9 

4.2 

.7 

6 

6 


9 

4.9 

3.9 

1.0 

? 

7 


10 

4.5 

4.2 

.3 

4 

4 


11 

3.6 

3.6 

0 

1 

Total 

1 

63.5 

-2.5 


To make this test do the following steps illustrated in table II. 

1. Obtain the difference d=Xv-Xc* 

2. Rank the absolute values of the d's, (in case of a tie, record 
the average of the ties). 

3. Place a negative sign on the rank of HI if d is negative. 

4. Sum the positive and negative ranks separately. 
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5. The test statistic T is the absolute value of^the smaller, su!^i, of 
the positive and negative ranks. T = 2.5 in our example. - 

The hypothesis that one wants to test is that the chlorine ^enapd 
as determined by the vendor and consumer are the same,. Or to stajte it 
in another way, it is that the median of the differences is zero^^ If , 
this hypothesis is trwe then one wo^ld find about the 8a,me numte^i of 
nositive differences as negative. 3o far this is the same as the, sign 
test. In order to take into account the magnitudes of these differences, 
they were ranked in absolute value. Now if the hypothesis is t^®f 
would expect the sum of the positive and negative ranks to be abpnt 
equal. Since the total sum of ranks is fixed for any problem kndv'ing 
the sum of positive ranks fixes the sum of the negative ranks. So the 
smaller sum has been taken as the tfS^ statistics. Since there dre 11 
pairs, N = 11. looking in the^ t^^^^ (1,3) of critical values of T, one 

finds at the 1 % level of significance T = 5. Since our T is. s^j^fer 
than 5 we will reject the hypothesis. This means that one would^^say 

that the analysis by the vendor and consumer do ..no| agree. 

It should be noted that both the sign test and the, Wilcoxqn. matched; 
pairs ranked-sign test are very easy and quickly done. There is;, no 
assumption as to normality nor is it assumed that they have a cOJ^on 
variance even if normality exists, as is necessary for a t test.,, 

THE CORNER TEST OF . ASSOCIATION |j 

Suppose that N (even number) observations of a bivariate ,di|ptri- 
bution are obtained and one would like to know if the two vari.ates are 
independently distributed. For this test we assume continuity ahd we 
also assume that our measurements .ape .at least fn the .o^inal s^ale. 

The corner test of association is easy to perform and will be explained 
by an example. Consider the X and ,Y measurements in table III. 



TABIE 

III 


Rank of X 

X 

Y 

Rank of Y 

1 

10.2 

97 

12 

2 

11.6 

71 

20 

3 

12.4 

83 

17 

4 

13.6 

111 

8 

5 

15.2 

96 

13 

6 

15.4 

69 

21 

7 

17.0 

88 

15 

a 

18.4 

120 

5 

9 

18.6 

78 

19 

10 

20.0 

112 

7 

11 

21.0 

58 

22 

12 

22.8 

115 

6 

13 

23.0 

135 

2 

14 

24.0 

80 

18 

15 

25.2 

109 

9 

16 

26.8 

89 

14 

17 

27.4 

128 

3 

18 

28.8 

105 

11 

19 

30.2 

84 

16 

20 

31.4 

122 

4 

21 

32.2 

139 

1 

22 

32.8 

108 

10 
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Scatter diagram for the X and Y measurements of table III 



10 12 14 16 18 20 22 24 26 28 30 32 34 

To make this test, do the following: 

1. Rank the X measurements to obtain the median 

2 . Rank the Y measurements to obtain the median Ym. 

3. Plot the points on a scatter diagram. 

4. Draw a vertical line through X^. 

5. Draw a horizontal line through ^m* 

(There will be 11 points on each side of the vertical line through 
the median of X and also there will be 11 points above and below 
the horizontal line through the median of Y. These t^^ro. lines will 
divide the points into four quadrants which will be numbered I 
through IV in the usual way. In making this test the points in 
quadrants I and HI will be taken as positive and the points in 
quadrants II and IV will be taken as negative.) 

6. Take any vertical line which is to the right oJE* all points and 
move it to the left until a point is reached which is on the 
opposite side of the horizontal median line from the furthest point 
on the right. Call this line L]_. Count the number of points to the 
right of L]_ and denote the number by r]_. If these points are in 
the first quadrant r-|_ will be taken as positive and if they are in 
the fourth quadrant will be taken as negative. In our example 

r-i * 3* 

7. In a similar way bring a vertical line in from the left and call 
this line L2. Count the number of points to, the left of L2 ^d 
denote the number ty r2» This number will b® taken as positive if 
the points lie in the third quadrant, otherwise it will be taken as 

negative . ' 

8. In a similar way bring a horizontal line down from the top and 

another up from the bottom calling these lines and Count 

the number above Lo and denoting the number by r^ which will be 
taken as positive if the points lie in the first quadrant, other- 
wise it will be taken as negative. Also count the number of points 
below Ljl and denoting the number by r^ which will be taken as 
positive if the points lie in the third quadrant. 

9. Compute the test statistic R - r^ + r2 + r3 + = 3 + 3 + 4 + 4 *"14 


348 



tables are needed for thi^ test for j|.;. 

if N^lO (22 in our example) and R^^ll or R^-ll we will 
reject the hypothesis of independence at the 5 % level ojT sig- 
nificance^ i! 

if N^IO and R J^15 or R4 -15 we will reject the hypothesis of 
independence at the 1^ level of significance, 

■ft • 

Since R = 14 in our example and if we choose the level of sig- 
nificance we will reject the hypothesis and conclude that the X*:s and 
Y's are assopiated in som® .If wf, 1 % level of ‘ signifi- 

cance^ we will accept the hypothesis of independence because we ■{failed 
to reject it . !i 

This test practically ignores the data at the center of the! 
scatter diagram and focuses attention to the points at the edges of 
the scatter diagram. The test does not measure the degree of association 
as does the correlation coefficient. !; 

For this test one assumes that the populations are continuous so 
no ties should oocur. If ties dp. occur they will requir special 
attention. If two (or four) points should lie on Y median line^’ then 
move the first .point up or down^ as determined by the toss of a 'coin, 
and move the other point in the opposite direction. The same thing 
applies for points lying on the X median line. If in constructing 
one of the L lines one meets with a set of tied observations, tl^en 
draw the line through these tied points but take the contribution to 
r to be 

n_ 


10. No 

a) 

b) 


where ng is the number of points in the tied set which are on the same 
side of the median line as the, initial point, and the number;:of 
them on the opposite side. !| 

Comments and conclusions .. . 

' . li ■ ■ 

For data that are measured in the nominal or ordinal scale;, one 
usually uses nonparametric tests. ij 

For small samples nonparametric methods are usually easierHo com- 
pute than the parametric methods, || 

For large samples it may be easier to use parametric tests!' since 
it can be tedious to rank data unless one has sorting equipment 

For data, that are expensive to obtain one would want to usb the 
most efficient test available, 

For nonparametric tests one does not specify the functionajt form 
of the frequency function. 

The three tests illustrated in this paper are only a. few of the 
tests available. It is hoped that the people working in statistics 
and Quality Control will become better acquainted with these noli-- 
parametric techniques as they could be most useful to them.' :|i; 
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INITIATING QUAIITI CqNTHOL AND QUALITI STANDARDS FOE NEW EEODDefS 

'ii- 

WilHam P. Cloyes 

TitairLum Metals Corporation of’ America 
Introduction i: 

The problem of establishing quality standards in a new indus'^ry 
is a difficult one, as many here will agree# In the first place, ' 
basic inf ormatipn is lacking which is iieeded for accurate applicaj- 
tion of modern control methods. Particularly, there is 

accumulated knowledge from past experience in the following two 
fields: ! 

■ ■ .ii ..... 

Ii 

1. Process capabilities 

2. Customer requirements I; 

Lack of information concerning process capabilities and customer 
requirements makes application of modern quality control methods ^ 
matter of continually aiming ones testing and inspection methods 
towards estabiishing proper quality standards. The aircraft industry 
as customer &s beep helpful and cooperative in setting up j; 
attainable specifications and eyaluating the quality requirements:; 
of this new metal, titanium. 

if- 

The purpose of this paper is to discuss in detail the quality- 
control deyelopmeirts -idthin Titanium Metals America 
during the past two years in establishing control and stand^ds jj 
together with the accomplishments made under this program. 


Background of the Quality Control Program 



As many here know, titanium is a new metal to American industry 
and America far outstrips the rest of the world in production of this 
metal* Titanivun metal is presently primarily' used in the manufacture 
of Jet aircraft— both for engine and airframe parts. It is particu- 
larly valuable in these applications due to its high strength at ! 
elevated temperatures up to 1000 degrees F, its extraordinary 
corrosion resistance, and its low weight compared to steel (specific 
gravity k*Sk vs. 7.92 or approximately h3>% lighter). 


Titanium Metals Corporation of America was formed in 19^0 as a 
joint venture by the National Lead Company and the Allegheny Ludlum 
Steel Corporation. TMCA has been fortunate in this background, ais 
Natioiaai Lead brought many years of experience in dealing with 
titanium chemicals Allegheny Ludlum^ years of experience in 
rolling and processing high-strength alloys. Titanium Metals Corjp- 
oration of Amerloa was the firs-t fully-integrated organization ip- 
the industry, with operations ranging from tibaniura ore thorough 
sponge production and ingot making, to the production of all mili 
products - billet, bar, sheet, strip, plate, wire, extrusions and 
tubing. The fantastic growth of the industry can be seen from tbs 
production figures of 3 tons of sponge in 19b8 against approxima-tiely 
lb,500 tons of sponge and approximately 5,300 tons of finished milll 
products in 1956. 
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The period since 1^50 has especially been a period of rapid ex- 
pansion, culminating the past two years in shipments quadrupling 
previous production records. This production increase has placed 
a continual heavy load on our quality control program, not onGLy to 
maintain a uniform quality level but also through additional quality 
controls and research, to improve our product to satisfy the customei 
increasing quality demands. 

Establishment of Quality Control Program 

TMCA*s first step in developing its quality control program was 
to make a survey of all of its operations from the raw materials 
through to the finished products. The report from this quality 
control survey provided a plan for long-range development of modem 
quality control methods in our company. The report suggested steps 
toward developing quality standards and quality control procedures 
throughout our operations and our program has basically followed 
these recommendations. 

TMCA*s program has been continuously under the direction of a 
Quality Control consultant. At the first of the year we created the 
new position of Quality Control Manager in our organization, Mr, 
David J, Ausmus, former Chairman of the Youngstown Section ASQC, has 
been selected for this position. 

Process Capabilities 

As stated above, our initial quality standards had to be set 
without accumulated knowledge of process capabilities, which would 
have permitted the setting of scientific specifications for processes 
and products. Orders had to be taken for new products, processes had 
to be developed, and products had to be produced — all without detaile 
knowledge of process capabilities. 

During the past two years, however, we have made careful studies 
of all of our operations and have developed substantial information 
concerning quality standards for our processes and products. These 
are now serving us well, and are explained below. 

Customer Requirements 

As new products have been developed, no information was immedi- 
ately available concerning the needed quality standards of customers 
over and above the stated specifications. We have found several 
properties chemical, physical, and visual, of titanium metal which 
were not covered in the original specifications but which had an 
important effect on the customer* s use of the metal. 

Even though these characteristics were not covered by specifica- 
tions, the customer needed protection and we have developed quality 
stand^ds and quality controls to cover these characteristics. 

Quality Standards in Ingot Manufacture 


The most important quality control problem in ingot manufacture 
is that of making tests and inspections which will correlate some 
considerable time later with specification quality of the finished 
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products. For e^^ple, customer specifications of fijdsMd products 
are usually in terms of tensile strength, yield strength, elongation, 
and reduction of area. However, titanium metal in ingot form caniiot 
be evaluated acciirateiy- in these terms. Therefore, the relation 
of associated ingot tests, such as Brine 11 hardness, needed to be;; 
closely established. ;■ 

We have made correlation studies of such and have 

established quality standards for ingot Brinell hardness that peri|£t 
us to know in advance how will work out in finished protiucts. 

The control of ingot Brinell hardness measurements Iffy 

standard X & R charts. - 

Information. from,.,these., control. is. .... 

management reports and distributed to interested pWsohs thrbughojijit 
our operations. 

Another important problem in iiigot quality control is maintaining 
physical uniformity or homogeneity of the ingot, such as avoidance of 
pipe in the ends of the ingot. Pipe is a void situation of some ^ength 

in the center of the ingot ends. We have been able to set up tes|»s 

for pipe in individual ingots at Henderson, Nevada and have correjjLated 
these with pipe losses in finished products at the mills in the E^ist, 
through use of statistical methods. Such correlations have proved of 
tremendous value and have enabled us to develop continuous contirbi^ 
procedures at Henderson which have substantially reduced our pipe ' 
losses in finished products* Frequency cSstributions of X & R arp 
also compiled for alloying and trace elements found in the nptal... 

Quality Standards In Mill Operations || 

We have developed sampling controls for determining process cap- 
abilities of gauge in flat-rolled products and have maintained th^se, 
on standard control cl^^ proved valuable in considbrixig 

what tolerance limits maybe guaranteed on close gauge orders* 

Standai-d X & R charts are also maintained for control of physicalj 
properties and a summary tally is issued t^^ 11 

...... .jj. . 

Similarly, we have used the niethpds discussed ip ’’Quality 
Control Techni-ques for Establishing Industrial Standards” (l) in 
developing quality standards for visual ch^a.cteristips 
products. These are still in process of development. 

ii: 

A testing program to eyaluate the testing results of THCA arid 
Allegheny Ludlum laboratories is also , in progress and this data ifill , 
be evaluated statistically. 

Current Dev el opments ii 

We have found that the methods of stftistical quality control 
have improved communication of . quality information among all Interested 
parties throughout our organisation. This has enabled us to t 
prompt action when quality standards are violated anywhere in thq 
processes. 
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From the above discussion, it will be noted that considerable 
progress has been made in our efforts to develop close quality- 
standards for our products and a quality control system that will 
continually meet such standards* We have a long-way to go toward 
our ultimate goal, but feel that we are on a solid road of progress 
toward that goal. 


Reference (l) Wareham, Ralph K*, ^'Quality Control Techniques for 
Establishing Industrial Standards" , National 
Convention Transactions 19$$, American Society 
for Quaii-ty Control, 3^9 - 3 • 
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DESIGNED EXPERIMENTS IN INDNSTRY 
By Dr, H. C. Hamaker 

Philips Research lAbprat or i es , Einci hoven, Netherlands 

and 

Rutgers University 


A number,, of ...lipt histories 
of the successful, application of designed experiments in industry.^ 

These examples then form the basis for a more detailed discussioj of 
some basic principles underlying the use of e:jqDerimentai designs in an 
industrial enyiro* It is, in particular pointed out that text- 
book treatments of the subject are far from satisfactory and that* im- 
portant changes are needed before experimental designs will bear .■full 
fruit in industry* 

Usually a large number of factors have, to be cpns^ 
art of experimentation eadsts^ in d^^ which of these factors :,^ould 

be varied in the first place and which be kept constant or studied in 
later experiments* The experimenter then proceeds by a series of suc- 
cessive experiments which joints provide the answer to this problem. 
This aspect is neglected in statistical textbooks where the analysis 
of a successfully designed experiment is discussed, not the true!; prob- 
lems involved in the design of the experiment itself. !| 

ii . . ■ ■ ■ 

In the literature there is far t^ on analysis of 

variance and the testing of hypotl^ses. In many cases properly arrang- 
ed tables of averages reveail the result of an experiment with .sujff icient 
clarity to serve as a baais for further exoeri mentation. More s|f»phisti- 
cated statistical analyses are uncalled for; ffiey may be used by the 
statistician to check the validity of the iriain cpnclusipns put 
should not find a place in his repoH t^^^ or at; best 

should be placed in an appendix. !; 

Technical and starisriP.^ significance are not sufficiently d!)Ls- 
tinguished. In a complex analysis of variance ve?y many effects.; in- 
cluding first and second order interacrici^^^^ turn out to oe statis- 
tically significant, but technicaliy they may be too small to bp; worth 
considering. In such rituations we shpuld pick out the large effects 
and report on these, pooling all the smaller effects ip 
pooled residual. Top much dptril the technologist and 
before something has been dc?ne on the large effects the small eijjfects 
are not worth worrying about. 

It is often emphasized in textbooks on statistics that we ca^i only 
tost our preconceived models sot up before the experiment was “made. 

The experimenter can never accept this point of view. To him the 
numerical deteriidnati parameters of a preconceived mod^p, may 

be of seme value indeed. But it rill often be of much greater 
if the experimental results suggest that the preconceived model -.was 
wrong and that an allrtogether different model has to replace i^j. The 
most successful work of the, statistician in, industry is where hi can 
show that such a change of model is needed. This will invariably lead 
to much more effsetiye and efficient of experimentation, 

■ T' T;:; -': 
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Statistical textbooks always show examples of designed experiments 
where the analysis previously explained does apply. In practice, how- 
ever, many designed experiments yield data from \diich it is at once 
obvious that the standard methods do not obtain and that some different 
method of treatment has to be adopted. The success of a statistician 
in industry will in a large measure depend on his ability to recognize 
these situations and deal with them effectively. They should be includ 
ed in the literature. 

The full impact of the Design of Experiments” will only be realized 
when the subject is taught in the universities as part and parcel of ex 
perimental science and not as a branch of statistics, itself a branch 
of mathematics. At present progress is hampered by the biassed outlook 
of the statisticians who see the subject too much from the standpoint 
of probability theoiy. 


356 



TSB TE|^ M.PRQMH 

, A.*,, Making 

The Carljorundum Company 
Introduction 

Klghty-eight per cent of tjie artlclM published lln 
"Induatclal Quality Control" have one author, ten per iioont 
have dual authorship and only an unimpressive two per 'cent 
have more than, twh ..autJ^prs • ( a) This might be taken as an 
indication that Quality Control is ..a .l.one-¥olf ^PPsnation* 
There niay well be some basis for this .ir^fere.nc§,..becaMp in 
the early days, in particular, a toroK was being cawied by 
lone individuals in many a^ organisation and the vetry "exist- 
ence of a quality TOntrol activity was due to their mission- 
ary zeal* Evan now, formally organized quality contisJ’l 
departments employing more than a vary few engineers, except 
in large organizations, are not the rule* Although the 
educational activities sponsored and encouragsd by the 
American Society for Quality Control. have reached ten| of 
thousands of people in industry, many are eons trained, ^to 
apply the techniques as a part-time assignment and wij^hout 
formal organizational recognition of their quality control 
function* In spite of the dependence on individual initia-, 
tive, however, the team approach has been used for a |.oi3ig 
time* 

; ■ , . ■ ■ : , , .. j|: . . , 

The margin between failure or success may in inahy in- 
stances have been the degree to which teciawbrk among the 
quality control engineer, technical people and produc|;ion 
persoxmel was .aoppmplished* Relatiy.ely little has be^n pub- 
lished about l^e use of the team approach, so that one might 
conclude that it was a natural rather than a consciout use 
on the part of many of those who succeeded* 


In a somewhat newer management ttphnique, Operaijbions 
Research, the concept of the team is ohe of the essei^jtial 
characterlstiCi* ^here are sp mAhy similarities between the 
cpnduot of Operations Research and Quality Control tl^t it 
seems desirakle that more li^t he shed on the part teamwork 
has to play in the latter technique* 


The Basentlal Character la tics of a Team 




A successful team Is remarkable ou several counts# It 
brings together a number of peoplei each of whom has lbome- 
thing different to contrlbP^te to ^ t^ solution of a problem# 
As individuals^ the members of the team recognize tmt each 

(a) Immediate source of information.: Mr* Ervin R* Taylor in 
a tentative proposal of the Bibliography Ccmmlttee, ASQC, 
for a Bibliographical Service, February 1957* 
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has something special to contribute to the success of a job* 
Mutual respect and a recognition of the talent and special 
attributes of the other members provide a basis for effect- 
ive cooperation. The work of the team Is so organized that 
the various nmnbers look at the same phases of each problem 
from a different point of view* 

In order to be recognizable as a team* the group work- 
ing together must have a common goal* The members must have 
a willingness to cooperate* It helps if they have had 
earlier mutual experiences* but since Hiere has to be a 
beginning sometime* even a group of strangers can be welded 
Into a team under the right conditions* A cardinal condltlcai 
is that each one recognize that no one Is competing In an- 
other man’s territory* 

Good mnnbers of a team must be willing to try new com- 
binations of ideas and things and to accept new approaches 
or attitudes* There must be a willingness to accept the 
Initiative in following up on plans agreed upon by the team* 
Each man must be able to work under self-direction after a 
general outline has been agreed upon* 

Cooperation must be j\ist as strong at planning stages 
as at stages of execution or evaluation of a plan* Members 
of the team must be able to take and give constructive criti- 
cism impartially* Each must have the ability to accept com- 
promise* to agree on definitions* on the setting of schedules 
and on the necessary limitation of Individual activity* A 
mark of a good team worker Is a willingness to share fairly 
the credit for a task well done * 

These characteristics are jvist as important whether the 
teamwork has come about naturally and artlessly or whether 
It has been the result of a coordinated plan* With the 
advent of professional teams In the consulting field as well 
as on the staffs of large manufacturing organizations* some 
additional general characteristics have become recognizable* 

Such teams have the support of top management and are 
given considerable freedom of action* The level of matwlty 
and professional ability is very high* Work of great respon- 
sibility Is attractive to capable people* The members of 
these teams are hand-picked* Because of the respect that 
they command* the team often has much influence and can 
evoke the authority to act when necessary* The very air of 
authority and assurance makes acconqillshment of difficult 
tasks possible* 

There Is great moral as well as technical force behind 
a team that has a systemmatlc program* There is a great ad- 
vantage In having a system for assignment of responsibility 
for action and In maintaining a strict check-off as action 
is taken* EiQ>erlenoe has led to the breaking down of com- 
plex projects Into parts of manageable size and to the 
assigning of each part to a specially qualified teem* often 
of not more than three to six men* 
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It nay ba inatpuatiya to reoiill sopif as^mplas of | appli'- 

oation of the fpragoing prlttalplaa fjpom paist ei^erlehiai 

whl^ In retpoipect appear to have been oharacterttefllhy 
good teanworkf to deacrlbe i^e ekP^Pbionally produetlye 
teamwork between J>nny Ordnance and the Bell Telephone i’liabar a- 
tories during and slnee the Korean War and to present :iaome 
current deyelopmenta in the team approach In process Quality 
control* 

Artless Uses of the Team Approach 
Teamwork on a Pilot Plant Problem 

A number of years ago, the genereO. management of!' a 
chemical company was providing a new and specialised |dyls- 
ory service to the plants In the foim of assistance In th^ 
Introduction of stst|stleal methods of quality contkol* The 
quality control staff had recognised, howeyef, that Ih the., 
chemical Industry the study of analytical precision shd 
statistical dieslgn of experimental work Should aoppsipshy or 
precede atteitq>ts toward process control* The e<^pahy quality 
conlarol engineer was therefore spending some time at h plant 
laboratory lu order to induce chemists and deyelopmeht engin- 
eers .to e3qpand.tlj»ir,..Mse..of .,,st§tl|||o|i;^'^t|^s*.', ' | ■ 

Also at the plant at the time was a staff proees'S engin- 
eer who was working with one of the proieot development 
chemists in the laboratory on a pilot plant operation* 

At the suggesHoh of the project engineer, the process engin- 
eer and the quality control engineer met with, him at the 
laboratory one morning to discuss the posslbllily of a chart 
method for control of the pilot plant* (b) The three imen ha4 
known each other for some time* The two from the hoite offies 
staff, althou^ they did not ordinarily work as a teihv both 
had eonsiderable experience In helping solve production prob- 
lems and both had expressed willingness to work together with 
interested project engineers on curre n t development hnoblems* 
This teiim met only once for a very brief time in oon^etion 
with problem mentioned and thereafter carried out a blah and 
achieved resaits , very rapidly* ihe details bf the plan have 
been published (1) and need not be repeated here* However, 
a brief description of the method of operation is essential* 

Data already at hand were used almost exolusive^y* A 
scatter diagram for the per cent conversion against one of 
the control character is tics was made using results of a 
Special run* The resulting scatter confirmed what wis known 
about the reaction* A curve was fitted to the plott|d points 
and plus and minus llislts were drawn about tiie curve "so that 
95 per cent of single determinations should lie within them 
if proper prooeSsing conditions were being maintained* 


(b) Members of the team were respectively Hr* John Drew, how 
with the Onosby chemical Company, Hr* Homer A* Shi^* 
now with the Hinerals and ChemiciAs Conp* of Axief iea, 
and the author* All three were formerly with the Hercules 
Powder Company* !! 
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Operators were instructed to raise or lower temperatures 
depending on position of each routine test with respect to 
the control limits# They found the method was much easier 
and quicker than the former tedious method of control# The 
project engineer began to experiment with different tempera- 
t\ 2 res# pimping rates# frequencies of catalyst change# and 
numbers and arrangements of reactor vessels# It was soon 
discovered that best conditions were produced by using the 
reactor with fresh catalyst ahead of the reactor with partial- 
ly spent catalyst# in contradiction of accepted procedures# 

It was estimated that the results were achieved six months 
earlier than would otherwise have been possible and that the 
total cost saving was ten per cent# 

One mi^t speculate on what elements in Ihis situation 
caused it to be rem^bered as so remarkable# It may be 
simply that all the essential conditions for successful team 
work were fully satisfied# 

Teamwork on a Plant Process Problem 

Another example of teamwork dating back to the early 
days of statistical quality control in chemical processes 
has been described recently# (2) This has to do with the in- 
troduction of control charts for the first time in a plant 
where supervision had almost no prior experience with statis- 
tical methods# The staff quality control engineer traveled 
to the plant# He met with the plant superintendent# the 
control chemist# and a development chexnist to discuss what 
should be done# (c) During a two day visit, this team review- 
ed preliminary charts showing prior data plotted between 
specification limits# studied the process to select appropri- 
ate control points and outlined a control chart program for 
three processes and a precision determination program for the 
principal chemical analyses involved# 

During succeeding months# the members of the team per- 
manently stationed at the plant worked steadily on achieving 
process control with occasional advice from the quality con- 
trol engineer# Within two months# the control laboratory 
had made replicate tests on homogeneous samples to arrive at 
precision figures for a 11 the principal control tests# Con- 
trol charts began to show a steady improvement in tiniformity# 
For one process# the control chart was of assistance in locat- 
ing an error in calibration of the feed tank for a raw mater- 
ial# Correction of this defect led to greater ease in handl- 
ing the process and greater uniformity in product# 

At the end of the first six months the uniformity of 
the various characteristics of one product had been improved 
anywhere from lf.3 per cent to per cent with an accompanying 


(c) This team consisted of Hr# Earl Radant# Mr# Jesse Loucks# 
Dr# John W# Smith# and the author# respectively# All 
were employees of the Hercules Powder Company# 
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reduction of 6-1/2 per cent In processing tlmeo For i&aother 
pfoduot* unlfonttlty of one characteristic Inproved 60 jiper 
cent and other characteristics were being brought into wh- 
trol* A third product was so much improved that it was 
possible to produce a TOP grade within speciflcationa ‘100^ 
of the time* 

Credit was eonsistOh'tly given to the fine teamwo]^k by 
the group put together at the plant to handle this project 
and their fine cooperation witfe„thft quality control engineer* 


Teamwork on an Industry-wide Basis 



On occaeiony ow industrial system gives rise tO'ioFPor- 
tunities for teipi eolisboretion of ah sort* ^n exas^ 
pie is an informal tec^ that had a' oohsiderahle Impact on 
the acceptance of statistical qualii^ control In the pulp 
and paper industry* (dl These thnee tnen* a research chemist» 
a technical service englneerji and a quality control eifiglneeri 
collaborated^ over , a period of years* All were employees of 
the same company hut were in different divisions* Afilw 
assignment to a common project broui^t them together*^ they 
continued to collaborate on a spontaneous basis* 


This collaboration consisted qf educational activities 
within the plants imd laboratories of the oompeij^ and in the 
plants of cus tamers * It Involved the planning, donduht, and 
analysis of mill trials of co®Pa>“y products* It involved 
introduction of quality control techniques to the plants of 
the e6iiQ>aE^ and of experimental techniques to its laborator- 
ies* It involved work in the Statistical Conmlttee of the 
Technical Association of the Pulp and Paper Industry*' It 
involved the preparation of bibliographies and the distrihu- 
tion of .technical jut tevisl on qviality control* It Involved 
personal selling of quality' control principles on mar^ pri- 
vate and social ocoasiorm* It involved mutual reviii^Lj^ld . 
criticism of plans, analyses, and reports' of testing* It 
involved publication of significant contributions of „the 
literature* It involved collaboration, in teaching short 
courses \U3ider the ansplees of the Technical Associatiion* 

The feelihg of identity of Interests, a hi^ mutual 
regard for each other *3 various, talents, and an unselfish, 
almost disinterested sharing of credit led to results none 
of the three coi^d have achieved, alone* 

Teamwork Perfected for National Defense j 

The tremendous Job done for Array Ordnance during the 
Korean War by the Quality Assurance Department of .tde Bell 

(d) This teem consisted of Hr* Richard T* Trelfa, a Fellow of 
ASQP, now Plant Superintendent, Watervliet Paper 'Co*, 
Harris Ware, now Tfenager of Teohnieal Servioe, Beveridge 
Paper Co*, and the author* All were of 

ttie Hercules Powder 'dampany* - n'r'Tr':'-'' , ■ 


Control of 10g> mm* Asaiunltion 
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Telephone Laboratories is well known. (3) The project for 
Quality Control of 105 mni. Complete Rounds resulted in suc- 
cessful production of an initial large lot of over 149»000 
rounds within which the dispersions of muzsle velocity and 
range were fully as low as for the very much smaller lots* 
of the order of 30*000 rounds, (e) produced prior to the 
beginning of the project* 

What has not been so well publicized is the fact that 
the success was due to the remarkable teamwork that existed 
between Bell Laboratories and Ordnance personnel* In the 
words of Hr* George D. Mwards* Project Engineer for Bell 
Laboratories* 

*burlng a considerable part of World War I 
and throughout practically the whole of World War 
II, I worked with various branches of the armed 
forces in a capacity somewhat similar to the one 
in which I now find myself. Never before have I 
experienced the sort of cooperation, and the genuine 
desire and ability to out red tape, and to do every- 
thing possible to forward the job, that the Ordnance 
Ammunition Center has shown*" 

This teamwork was the result of a new concept in organi- 
zation* The contract called for Bell Laboratories to provide 
a skeleton organization of quality control engineers and for 
Ordnance to parallel this with an organization of 'opposite 
numbers' in each case* There were two reasons put forward 
for this provision: first, to keep the cost of the contract 
as low as possible; and second, to train Ordnance personnel 
as rapidly as possible, so that they could take over full 
responsibility for the work at the earliest possible moment* 
Actually, the 'opposite number* concept evolved as an extreme- 
ly valuable organizational principle, end has been applied 
successfully to later Bell Laboratories-Army Ordnance projects 
and is being tised successfully in Industry* 

Throughout the 10^ mm. project the team was favored with 
constant help ajad cooperation of the regular Ordnance super- 
visors and personnel as consultants, advisers, and as instruc- 
tors in ammunition to Bell Laboratories engineers. Also* 
Ordnance contractor personnel from American Safely Razor* 
Chevrolet Shell, General American Transportation, Goodyear 
Engineering, Eelsey-Hayes Wheel, Malleable Iron Range, and 
Thor Corporation, were most helpful at all times* 

Quoting Hr* George Edwards again* 

"Process quality control is freqtiently an 
elusive sort of thing* We (the Bell Laboratories 
members of the team) have certain standard tools. 


(e) Lot sizes were commonly much smaller than this during 
World War II, being then of the order of 3000 - 4000 
rounds* Ordinary quality control techniques had Increas- 
the lot size to about 30,000 before Korea* 
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such as control charts, analysis of variance, 
etc*, which we can apply* But if none of them 
work, we still have to get the answer, and we 
are forced to fall hack on ‘ingenious devices’ 
for doing so* That is when F 
and 035perience ane ahle to make a very special 
contribution tp the job*'* 

Quality Assurance Program for the Hike Missile 

This use of opposite numbers worked o^t.j.oi very will 
that when, in 1951|., Bell Laboratories undertook, the asifdgn- 
ment of developing quality assiaranoe procedures for the Nike 
I guided missile,, it was again included as a opntractufl re«* 
qulrement* (q.) Althou^ the far-flung organization reQhired 
to cope with a production effort of the size of this p^e 
made difficult the keeping of an effeotive team in the;, field, 
a iQajor effort was made throu^out the contract to maintain 
the balance of ’opposite numbers* on the team* This effort 
was fully vindicated* 

Another excellent exan^le of the use of the team ap- 
proach, althou^ not hew, (f ) was the practice of using the 
committee technique in making qtiality surveys of various 
components and sub-assemblies of the missile* The Survey 
Committee usually consisted of three memhers, authorized to 
represent respectively the quality assurance agency, ttie 
inspection agency, and the supplier* For example the first 
quality survey on the Nike Project involved the ballistle 
test of the booster* The comittee consisted of a Bell Laboir- 
atories quality control engiheer, and w ^dnance ’opposite 
numberi from the project office (for the Quality Assurance 
Agency), an engineer from the plant manufacturing the booster 
(for the supplier) and the ^dnance resident, inspector, from 
the plant (for the inspection agency) * (g) 

The operation of a quality survey coinnittee has be^n 
described by Mp, E*G*D* Paterson, who stq>ervised the Njike 
Quality Assurance project* (5) ,, ij 

'■■■ij' ■ ■ 

Each member of a survey committee was responsible for 
those factors affecting quality which were within his purview* 
For convenience, the subject areas were divide^ as folilows; 

A# equality Assiirance Agency 

1* Contracts, specifications and drawings 
2* Exsoftinatlon of a sample of current product 
3# Inspection proce^r-es | 

L* Inspection results and surveillance reat:d 
Service complaints 
6, Review of quality standards 

(f) A quality survey procedure employing a committee or team 
approach had been in successful operation in the ^11 
Telephone System for something over 2 $ years* 

(g) This team eoxmisted of Messrs * Q*R* Quuse, N*C* Ofirdncr, 
A.P* Qlacco, and M*C* Willard, respectively* 
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Bt Inspection Agency 


!• Inspection procedures 

2« Gage and test set calibration and records 
3* Service complaints 

C« Supplier 

Manxifacturing drawingSf handbooks^ and layouts 
Manufacturing facilities^ including gages and 
test sets 

Manufacturing inspection procedwes 
Manufacturing difficulties 
Raw materials inspection 

The committee survey technique as used by the Bell Lab- 
oratories has an impressive record of success • 

Artful Use of the Team Approach 

In a recent paper^ (6) General Leslie £• Simon sxiggested 
that, partlcTilarly if operations are large or complex, launch- 
ing of a statistical quality control program ”can be done 
most economically by assemblixig a crew of experts to design, 
install and initially operate the S#Q«C« system#** He suggest- 
ed, also, that ’’concurrently, * opposite nvmibers* drawn from 
existing personnel or obtained by recrullaiient, must be assign- 
ed to training so that they can take over the operation from 
the experts •** 

Continuing to quote General Simon, 

’’The installers of a quality control system 
must secure teamwork between themselves and operat- 
ing personnel to devise alterations in process and 
in process inspection for the purpose of bringing 
each stage of the process to a state where it will 
respond to statistical control# It is very import- 
ant that the installers of S#Q#C# and the permanent 
personnel be friends# 

’’The exercise of ingenuity both in statistics 
and in engineering is necessary to bring a process 
under statistical conti>ol# Changes must be made in 
the flow of product so that each Increment arising 
from a different source can be checked for quality 
before it is allowed to mix and lose its identity# 

New inspection points must be set up for each check 
point# The most knowledgeable people associated 
with the process must be brought together to seek 
out causes for lack of control and devise ways and 
means for their elimination#” 

This is the general concept of staff quality control 
organization now being carried out at The Carborundum Company# 
In the early stages, the size of the team has been variable 
both because new members of the quality control group have 
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been in training and because some miss ipniiPy work has 'io be 
done befpre operating divisions see tHe problem clearly 
enough to make permanent assignments to the team* Eventually* 
it is es^ected that each study involving a major procei^'s ’Kill 
call for a team of perhaps three members of toe quality' con- 
trol staff; a senior qtiality control engineer plus t«o ;; junior 
engineers or quality control technicians* It is expected 
that operations will appoint two or three engineers orlitech- 
nlclans to each teem* 

The senior engineer is captain of toe team and Is j' re- 
sponsible for all phases of planning and execution of fhe 
program for the asslgied process* Assisted by menbersiof 
his team he makes a verbal report of progress at a weekly 
staff meeting* He organizes a brief, factual progress "report 
at the end of each monto* This is combined with otber„team 
reports in a report by the Quality Con tool Maimger to the 
Vice President in charge of Research end IJevelopmont* ::The 
team captain, or the responsible members of his team, write 
technical reports including conclusioxu and reeommen^Uijtlpjn 
at the oompletl(m of each major phase of toe program* These 
reports are checked with the operating division membei^ of 
toe team and with operating supervision and are issued:^ joint- 
ly* Appropriate actions are aesigned either to toei Qt^lity 
Control Branch or to toe Operaiting Bepartment* At the;: com- 
pletion of the study of a process, a final report or rioports 
sure written auid the process control system established is 
turned oyer to toe cooperating division for routine_opej?atlon* 
The concept calls for routine suirveillanee of each completed 
program to assure its continued effectiveness* 

, . Jilv . ■ . . . 

'■ ' ‘ ‘ ' ' ■ - ■ ■ ■■ ... .\l . . 

Conclusion 

Several types of team approach to a statistical (^ualitST 
oohtrol program have been mentioned* First* there Is the 
frequently found approach which relies upon individual initi- 
ative* A one-man quality control department must use ;tois 
approach or vegetate in an ivory tower* Secondly, there is 
the use of lopposite numbers* in a team mads up more hr less 
equally from a consulting* or stel^f ^oup* and iui opei^atlng 
group* This has been very useful in stepping up effort on 
particular programs and carrying them to most rapii sonolus- 
ions* Finally, there is toe conscious effort to explhit the 
team approach in the operation of a staff quality control 
function in a multl-diyislon manufacturing organization* 

This promises to maximize toe Impact of quality control in 
breadth and depth* 

There are some difficulties invoiyed in toe suocfssfiil 
use of teams that are formally organized and strictly 'assigned 
to a project, particularly if the pirajeet is of limited dura- 
tioh* It is difficult to put together a team if the future 
of toe assignment is not completely clear* Individuals may 
be doubtful about toat. happens upon completion of the|;projeet* 
On the Bell laboratories-Ordnance projects, difficulty was 
experienced in inducing people to move to a looatlon geograph- 
ically distant from home base on a temporary and even;. uncertain 
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basis o This was more difficult when Ordnance people moved 
to the Laboratories to take part in the Nike project than 
when the Laboratories moved some of its staff to the Ordnance 
Ammvinition Center for the 10? mm« project# Both of these 
projects had the additional disadvantage that the production 
operations concerned were scattered throiighout the country# 

There is the difficulty of finding suitable people in 
operating divisions which have never used S#Q#C# to assign 
to the teams# Usually, available people also have routine 
duties which either must be neglected or at least temporarily 
reassigned# 

There is the effort attendant to training someone from 
the operating group to take over the procedures when the team 
completes its work and pulls out# 

Finally, there is the Increased problem of coimiimications 
when larger numbers of people are directly involved in a pro- 
ject# 


These disadvantages are more than off-set by the many 
advantages of the team approach# Once communication is estab- 
lished# results are achieved much faster than would be possi- 
ble otherwise# 

Industrial relations are improved by the feeling of 
belonging to the team# The use of the term ^opposite n\ambers» 
is perhaps unfortunate because exactly the reverse of opposi- 
tion is implied by teamwork# Perhaps an improvement could be 
made by refei»rlng to the team as made up of "complementary 
members" from the quality control staff and the operating 
division. 

Another point in favor of the team is that experience 
has demonstrated that it is the most effective way of opera- 
ting quality control as a staff service# 

Perhaps the greatest advantage of all lies in the fact 
that once a procedure has been agreed upon and put in opera- 
tion it has a greater likelihood of sticking since those most 
closely concerned, the operating people themselves, have had 
a part in the whole endeavor# 
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STAHSTICAL AFPnCATION IN THE CONTROL ji 

OF HIGH SPEED FILLING MACHINES 'j ^ 

Francis X« Donohue 
The Nestl4 Companiy, Inc# 

The control of weights in the modern, high-speed filling line is 
tremendously in^jortant, particularly in consideration of (a) economic 
factors, (b) sound c(»imercial and consumer relationships, and ^c) con- 
tinuous conformance to legislative requirements pertaining to package 
weights# 

I do not believe that there is a^ need to discuss these flactors in 
great detail as they have been thoroughly and adequately covered else- 
where# It is sufficient to say that economic factors are usually the 
most compelling motives for close control of filling operation^ simply 
because the annual losses due to excessive overfill or ’’give ai^ay^ can 
easily represent many thousands of dollars# Filling losses are sn easy 
target for modern cost analysis techniques which seem to elevate such 
excesses to bold relief# The compelling need for wei^t contj^l of 
package filling lines presents a real challenge to the quality control 
engineer# 

In filling control, the basic goal might be defined as that of 
establishing the average filled weight at the lowest level cohsistsnt 
with the declared label w:sight and good commercial practice# Jn our ex- 
perience, package weights usually conform to normal distributions # Con- 
sider the very simple sketch shown in figure 1 in which the distribution 
of package weights is graphically shown in relationship to theMeclared 
label weights# I: 

i! " 

Federal regulations covering package weights require that - the 
average weight of a lot be at least equal to label weight and |hat there 
be no unreasonable shortage in any one package# They do not require 
that each Indi^dual package be of label weight# The principal excep- 
tion to the above is found in those instances where the label 4®<3lara« 
tion specifies a minimum weight in which case all packages must contain 
the declared weight# This latter Si tuatio relatively infrequent- 

ly, however# 

It is apparent that one way of establishing a target average for a 
given filling operation would be in terms of (a) a tolerance s|>ecifica- 
tion for the percentage of underfilled individuajj i^^^^ frofc the 
line that are acceptable 5 and/or (b) the maximum shortage in 
individual that is acceptable# Either or both of ^ese^ re may 

be zero# Having established these tolerances, one end of the jkstribu- 
tion becomes fixed by the limiting factor# The average overfill then 
will be dsterminsd principally by the filling variability# Ha^ng es- 
tablished one end of the diatributipn, the only practical measure for 
decreasing the average overfill, without changing the specification, is 
the reduction of filling variability# It is for this reason t^^ 
thorotigh investigation and evaluation of filliiig line variability is 
reconmended as the first step in approaching a control problem'; of this 
sort# ■ 

Digressing for a moment, I wish to make it perfectly clear that the 
definition of acceptable weight tolerances for a particular package 
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Distribution of Net Weights 

Helationship of Decreased Filling Variability to Overfill 



is a subject for management decision* The variability of the package 
weights depends entirely upon the capabilities of the filling eq-uipment 
used and the characteristics of the material being filled* Therefore, 
specific definitions of acceptable net weight variability must be re- 
solved in the light of the circumstances which comprise a particular 
situation* 

Bie control problem naturally resolves itself into two parts* First, 
one must estimate the process variability and, secondly, a technique must 
be devised for the control of the line that is sufficiently rapid and 
sensitive to match the capacity of the filling machine under considera- 
tion* 


Very often, variability patterns for filling operations are complex 
and confusing* This is particularly true of multi-head machines where 
overall estimates of a filling variability are in reality a ccmbination 
of variances that include the following factors. 

(1) Product variability 

(2) VaH.ance due to a difference in the average weights filled ty 
individual heads 

(3) Lack of hoaogeneity of variability in distribution of individ- 
uals from the several heads 

(U) Sampling error 

One of the most useful techniques in the evaluation of filling line 
variability is the replicated factorial analysis of variance* In this 
connection, 100? sampling for very short periods of time has been most 
usefVil* To illustrate, a typical data analysis is shown in figures 2, 

3, h sjod 5 attached* All of these figures refer to large scale filling 
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Frequenqr Frequency 



FIG. 2 



Frequency Distribution 
of Net Weights Filled on Unit B 

FIG. 3 
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FILLING CX)NTROL TEST DATk^ 
VARIANCE ANALYSIS PRODUgriON FfeM UNIT A 

Tisst 1 Test 2 Teat 3 



Sample 

Sao^le 

Sample 


Head 

1 

2 

1 

2 

1 

2 

Average 

1 

-1 

-1 

0 

0 

-2 

-1 

— Oo8 

2 

2 

0 

2 

0 

1 

1 

1.0 

3 

0 

2 

2 

1 

3 

-1 

1.2 

k 

0 

1 

2 

0 

0 

2 

0.8 

5 

0 

1 

3 

0 

k 

3 

1.8 

6 

0 

-1 

3 

1 

1 

2 

1.0 

7 

-1 

-2 

1 

0 

2 

-2 

-0.3 

8 

5 

u 

5 

5 

5 

1* 

U.7 

9 

U 

5 

k 

h 

6 

3 

U.3 

10 

-5 

-3 

-1 

-1 

-1 

-1 

-2.0 

11 

0 

-1 

-1 

-1 

1 

0 

-0.3 

12 

2 

2 

0 

-1 

3 

2 

1.3 

13 

3 

3 

U 

2 

6 

6 

ii.O 

lit 

2 

1 

2 

1 

2 

1 

1.5 

15 

1 

1 

-1 

1 

1 

1 

0.7 

16 

2 

2 

1 

2 

2 

2 

1.8 

17 

0 

0 

0 

0 

2 

1 

0.5 

18 

3 

5 

5 

s 

3 

3 

U.0 

19 

1 

0 

3 

1 

-1 

-2 

0.3 

20 

-3 

-2 

-1 

-1 

-1 

-2 

-1.7 

21 

-1 

-1 

1 

1 

1 

1 

0.3 

22 

-2 

-1 

-1 

0 

0 

0 

—0.6 

23 

3 

1 

2 

1 

2 

2 

1.8 

2I» 

2 

3 

2 

2 

1 

0 

1.7 

Ay. 


.75 

1.25 

1.38 

1.13 


FIG* h 


*A11 data coded 
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FILLING QOHTROL BST DATA* 
VARIANCE AN^EISIS PI«3DnCTION FRiMt UNIT B 


Teat 1 IbsV 2 3 

Sample Sample Saa^Ie 

Head 1 2 1 2 12 Average 


1 

2 

2 

2 

2 

2 

-1 

1,5 

2 

2 

2 

X 

3 

U 


2,7 

3 

1 

1 

2 

2 

1 

1 

1.3 

h 

2 

2 

2 

1 

2 

2 

1.8 

5 

-1 

1 

5 

u 

u 

2 

2.5 

6 

5 

5 

U 

u 

5 

u 

U.5 

7 

2 

2 

2 

2 

2 

2 

2.0 

8 

3 

2 

1 

5 

2 

3 

2,7 

9 

2 

2 

1 

1 

3 

3 

2.0 

10 

1 

2 

3 

2 

2 

3 

2,2 

■11^^ 

k 

3 

U 

3 

3 

2 

3.2 

12 

1 

1 

3 

1 

0 

2 

1.3 

13 

0 

0 

3 

2 

2 

0 

1.2 

lU 

1 

1 

1 

0 

1 

2 

1.0 

15 

1 

2 

3 

1 

1 

i 

1.5 

AVa 

1,80 

2,33 

2, 

ao 

2.08 


PIG# 5 

*All data coded 
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operatiOTS and you idll note that the data is coded and therefore has 
no absolute significance. I should also mention that figures 2 and L 
represent typical production from a high-speed filling line which ' 

excess of 200 units per minute (Unit A), Figures 3 
and 5 describe the performance of a similar machine (Unit B) that 
operates at speeds of approximately l5b units per minute. 

construction of these figures are the net 
series of sanqsles drawn from each machine. Sach series 
consists of two consecutively filled samples drawn frcm each filling 
tead. Ihe samples were drawn at randomly selected times over a three- 
our period. During the test periods, the machines were controlled by 
^ operator who drw frequent individual random samples and made such 
TOjustments as he felt were necessary. No control charts were used by 
the operator a^ his sole criteria of control was the requirement that 
the average weight should be maintained at the lowest level consistent 
mith producing all units of label weight. 


,®®f®^f^"8 first to the frequon<gr distributions shown in figures 3 
the variability in production from Unit A is 
^ production frem Unit B, The 
calculated standard deviations are, in fact, 2,0 and 1.3 respectively. 

filing variability could be used as a basis for con- 
struction of control chart operating limits. However, as previously 
noted, overall estimates like these are actually a combination of Mver- 

controllable. Ib illustrate, the data 
^ ®®“®^*^cted are also shewn in the well 

]:®rtance analysis format. Figures U and 5 are actually 
reflect in themselves something of the 
overall variability, Ihe detailed calculations re- 
qwred for the variance analysis are not shown. However, they are rela- 

^ subject, A com- 

perative summary of the mean squares is shown in figure 6, 


sumavRY OF vartahub 



Unit A 


Unit B 



^an Square 

Dif* 

Mean Square 


Between Heads 
Between Tests 

18.83 

5.25 

23 

2 

5.14 

2,10 

Hi 

2 

H X C 

Residual 

1.88 
• 79 

li6 

72 

1,67 

.77 

28 

Total 


lir3 


89 


FIG. 6 
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Perhaps the most interesting result of this test is found i|i the 
residuals which are substantially the same* In the case of Unit 
there is a relatiyely large interaction, which subsequent tests revealed 
to be somewhat abnoinnal. This was probably due to the fact that several 
of the filling heads became partially plugged during the test* lirith 
regard to the between test main effept, A evidenced signifipanqe at 

the 55^ confidence level* This is simply interpreted to mean that a® A 
result of yariations in the physical characteristics of the powd^Sr 
during the fill period, the overall machine average varied si gnijicantly 
with respect to the inherent variability of the machine to produpe uni- 
form weights* It is also an indication of the inadequacy of the? control 
systems employed at the time of the test* The between bead maip’ effect 
in both units was highly significant* It is quite obvious that ihe 
principal problem in controlling these units is the reduction ahS vari- 
ability of the average weights iss\iing from the individual filliing 
beads* Motivated by the results of tests such as these, corrective 
measures were vu^ertalcen which have substa reduced this varia- 
bility, particular iy on Unit A* I; 

Having establishod a reasonably clear picture of filling variabil- 
ity, two conclusions can be drawn* It is apparent that the two machines 
are characterized by approximately the same inherent capacity to fill 
imifom weights assuming, of course, that the fill from ite individual 
heads can be uniformly maintained at essentially the same level* 

Secondly, the residuals in themselves provide a preliminary estimate of 
the theoretical capacity of the machines to These 

estimates could be used as a basis for calculating operating cohtrol 
limits. 

In developing the specific control technique, consideratiorjt must 
be given to other factors* The product is packed in glass which makes 
gross weighing procedures cumbersome and difficult but not impossible * 
This mfans then th^^^ has to be resorted to* The control 

of machine average can be accomplished in several ways* A control 
based on individual samples is rather impractical because the t^e re-» 
quired for evaluatihg enough samples to get a reasonable estimate of 
machine average is excessive when the machine average is shlftli^* The 
target average fill can be set very close to the label weight without 
undue risk of producing underweight units providing the control technique 
is sufficiently sensitive to detect incipient shifts in average ; fill 
which are occasionally encountered* || 

Another factor that has an important effect on the control ■ of fill- 
ing Is concerned with the accur^ sensitivity and speed of the balances 
used* Actually, this is a subject in itself which cannot be adequately 
covered here* For our purposes, it is sufficient to note that i,n some 
cases it is impossible to obtain a scale that for production con- 

trol purposes, weigh with sufficient accuracy and speed to detect 
gradxial shifts in average within normal control limits* For instance, 
if the best scale for a given situation can weigh accurately to the 
neai^st hundredth of an ounce, it will be difficult to use this ’ balance 
to control an operation whose normal total varlabillt.y is ±*02 !,h^dredth8 
of an ounce* Under such circumstances, a control technique that Tdll 
magnify the amplitude of the control limits is required* To th|s end, 
the expedient of using the total weight of three samples as the I; control, 
variable was employed* 
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The control limit calculations were based on the estimates of 
standard deviations for individuals* The total weight of N individuals 
is equal to N multiplied by the average weight of the individuals* The 
standard deviation of the total weights will be N times the standard 
deviation of the averages* The standard deviations of averages of N 
samoles is equal to the standard deviations of individuals divided by 
the square root of N* It follows then that the standard deviation of 
the totals of N san^les is equal to the product of the standard devia- 
tion of individuals and the square root of N. 

In establishim; an estimate of the standard deviations of individu- 
als, one is confronted with the problem of obtaining a proper estimate. 
Actually, there are two valid sources of such an estimate available* 

The standard deviations can be computed directly from frequency distri- 
butions such as shown above. Such an estimate may include elements of 
variability idiich are controllable if identified as such. 

Another legitimate and very useful source of an estimate of sigma 
is the residual of the analysis of variance* The residual variance is, 
in a sense, a measure of the inherent variability of the machine to 
produce xinifom packages making the assumption, of course, that all 
heads are adjusted to fill essentially the same average weight. In some 
cases, this statanent would have to be modified to include sources of 
variability which may be inherent to the operation of the machine only 
because they are uncontrolled* For instance, we occasionally encounter 
a situation where there will be a significant variability introduced 
and reflected in the 'between sample' effect which actually reflects the 
variability due to differences in the product packed at different times* 
Very often, such variances are uncontrollable or controllable only at 
great expense* In aqy case, it should be recognized that the use of 
control limits, based on estimates of a filling machine's inherent 
variability, may result in a situation where the control limits appear 
to be extraordinarily tight* This would, of course, depend on how much 
of the controllable variability had been eliminated. 

In our example, the average residual variance is *78* The corre- 
sponding standard deviation is *37 which can be rounded off to 0*9 units* 
Control limits for individuals will be i^2*7« If one arbitrarily estab- 
lishes, as a criteria of acceptable filling, the requirement that not 
more than 2^$% of the individual package may be underweight, the target 
average for individuals would be two standard deviations over label 
weight* The control limits for the total weights of three random 
samples will be ±3fT (0*9) =tl 4 * 8 * The process average must be set at 
the total weight equivalent to two standard deviations of individuals 
over label weight if the specified requirements are to be met, 

(i*e*) 3o2 units* 

It must be remembered that such a system will permit the control of 
machine average only and is unable to detect or control variation in 
individual weights which may develop as a result of slight shifts in 
averages on two or more heads which are compensating* This is to say 
that one head may be drifting toward the light wei^ts and another head 
may be drifting toward the heavy side simultaneously, with the net 
effect that such variance may not be reflected in the control of machine 
averages* It is therefore necessary that the average weights issuing 
from the individual heads be regularly checked. This is done by period- 
ically sampling units filled in each head. The total weights of three 
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consecutive samples is th^n deterained* obvious tha^i there 

Hill always be some variation in the average weights of the indiyidual 
heads* However, the only problem that has to be resolved is defjlning 
the limits at which individual head adjustments must be made© For tl:ds 
purpose, we have computed warning limits employing two standard de'^la- 
tions of the totals employed for machine average control* These, 'warn- 
ing limits are useful to the machine operator since two successive 
weights between the warning and the absolute tolerance limits ar^ con- 
sidered as sufficient justification fpr a ' 

The overall control by frei^uent 

random sampling of packages filled by the machine* Three of the.se sam- 
ples are simply emptied into a suitable container and weighed on an 
appropriate balance; the weights are recorded automatically and ;^just- 
ments are msde yfhen necess Supplementing this basic con 
as a part of regular procedure, three consecutive samples are period- 
ically drawn from each heaci and the total weights of the three 
are deteimined to ascertain that all of the heads are filling to sub- 
stantially the same averse weights as defined by the established 
limits* The frequency of sampling varies from process to process and 
depends entirely upon the time rate change that the filling machine is 
capable of exhibiting. Sampling should be frequent to preclude jlthe 
possibility of sudden shifts in average or variability going undetected 
by the machine operator. j| 

By way of recapitulation, filling line weight coiitrol is often 
complicated by unknown or unevaluated sources of variability* $irople 
variance analysis techniques are extremely usefhl in eliM 
obscure sources of va lability which would otheCTise go undetected or 
unappre dated* A few such sources, hot specifically considered;in this 
report, are temperature, relative humidity, and product density which 
have a decided influence on the uniformity of filling line performance© 
Variance analysis techniques readily lend themseH the investiga- 
tion and evaluation of such factors© 

Specific control techniques have to be tdlored to satisfy the 
particular requirements of each problem. In some cases, like tSie one 
discussed, it is necessary to make provisions for limitations of weigh- 
ing equipment particularly with regard to speed* The proposed technique 
of emplq^ng the total Weight of several samples as the controlled 
variable is useful ®any possibilities© It can, for instance, be 
used in developing a program of control by gross case weights* This is 
a subject in itself ^d involves consideration of package material vari- 
ances* However, under proper conditions, it can be extremely Effective 
from a control standpoint and very attractive because of reduced sampl- 
ing and inspection costs. It also has the distinct advantage df adjust- 
ing case weights to any prescribed level thereby affording any ‘desired 
degree of assurance that all cases will be equivalen to the declared 
label' wei^t*- ' / 

One final consideration has to do with the costs of installing and 
maintaining control procedures* Quite obviously. It is possible to de- 
velop highly refined control programs, which can be extremely expensive* 
There is a break-even point in weight control where the cost of improved 
control is equal to the sayings due to decreased over-fill* Tliere is 
little point in pursuing weight control beyond the break-even |3oint, all 
other factors being equal* In short, common sense is essential in all 
aspects of the development of a control program* 
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*»SEEMAOTICS, SCAIES, kW) SkVimS THROUGH S.Q.C.’» 

i| 

Lindsqn P. Anderson and Richard D* Kornbluni i| 

Armour and Conpancr i: ' 

The three factors Involyed in ouLr title,: **Se,®ntics, Scales, and 

Savings** are all involved and inter-related in this discussion ;bf pur 
experiences with' Quality Control and statistical techniques at 
Armoinr and , Company . !^ : 

.if ... 

vSpecific instances dealing with each of the above factors lare the 
most illustrative means of beginning our discussion. | 

Ifebster tells us that "Semantics** is the study of the meaning of 
words. The relationship with S.Q.C. has been well expressed by 
Lord Kelvin when he said, **tbat when you can measure what you dii^e speak- 
ing about, and express it in numbers, you know something about "it. Bu.t 
when you cannot measure it, vjhen you cannot express it in numbers, your 
knowledge is of a meager and tinsatisfactoiy kind.’* i: 

Some of the case; histories relatii^ to our semantics problem 
involve the application of ’’pure** statistics while others involve more 
prosaic techniques. ¥e shall start with a statistical problem ■anproach, 

Several years ago, vre experienced an undue amount of .labeling line 
stoppage due to jamming of the equipment when labeling one specific 
canned product. Visual inspection shov/ed the labels , to be '*ri4!ihg^* 
over the can. The semantic problem then arose - we said, the labels 
were too wide| the label supplier said our cans varied excessively in 
height. To resolve this semantics, hassle, we conducted a .statistical 
analysis of one week*. s labeling operation for the product invoiyed. 

Vh found the following situation existed. 


FIG. I 



379 



^j'h readily could see that a goodly % of the labels were too large 
for the can outside width and thus jamming ensued* The label supplier 
was given these findings through the medium of figtires rather than 
words with genuine cooperation following as to quick improvement in 
label width variations* 

A more routine^ but nevertheless very educational problem in 
semantics began at 8:00 A.M. one Monday when we Tidieeled a portable 
electronics ^accept or reject” scale into a packaging department that 
had been producing package weights in considerable assortments, but 
generally on the high side. ¥e proceeded to route the entire depart- 
mental output through the electronic scale, setting the scale so as 
to reject any packages l/k ounce or more over the declared net weight, 
as well as to reject any light weight packages. By 10:00 A*M. we had 
accumulated Yery few undeDTweights but had $0% of the department's 
production in the overweight reject bins* The outraged foreman erected 
a semantic barrier by announcing that our electronic scale was ‘'crumuy”, 
and we should get a good scale that did not hold up his production. 
Fortunately, the division superintendent understood the meaning of our 
exploratory test and, after a short conference with the “cooled off” 
foreman, initiated scaling reforms among the packaging operators* 

Later checks have shown a great improvement in scaling excess over- 
weights without creating additional underweights* 

Other examples of the use of “clean” statistics to cut through 
the semantics problem are; 

1. Design of, and analysis of results from consumer taste 
panels. Here we determine whether so-called differences 
in product could be due to inherently normal variations 
in taste, smell, and sight, or are the result of control- 
label factors. 

2. Design and analysis of plant experiments so as to mean- 
ingfully and economically evaluate new equipment and 
processes so as to detect true process improvements 
distinct from normal random fluctuations* 

That “economical” reference is an additional asset accruing from 
an experiment designed by statistical techniques, since these methods 
of experimental design eliiTd.nate excessive testing for unwanted 
spurious factors, and yet allow for measuring the extent of testing 
error and interaction between factors under test. Additional benefits 
realized from statistical experimental design include the randomization 
factors that eliminate unconscious (or otherwise) biases in judging or 
evaluating the process or product being tested* 

These examples vividly illustrated to us how statistical studies 
can be of real help in breaking the “semantics barrier” - how they act 
to stop the confusing and non-productive arguments resulting from lack 
of reliable data* Statistical techniques are tools in the semantics 
area - searchlights in any problem that requires measuring and defining. 

Let us now turn our attention to the “scaling” part of our expe- 
riences • 
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In the following example, we will refer to the operations ijf 
"scaling'* or '^weighing** as used in our industry. However, the |ihi~ 
losophies and facts OTderlying this example are fundamental to |he 
situation regardless of the specific industry or operation. For 
"scaling** or "weighing" you can easily substitute the term appropriate 
to your operation, such as "metering", "measuring", determining [chem- 
ical concentration, etc* ‘ ‘ ' 

^ :• jj. 

Virtually every one of our products, and most likely yours ’ 
involves weighing (metering or measuring) at some stages of its .'proc- 
essing and packaging. The necessity of accurate scales, well main- 
tained by competent mechanics and, accurate scaling techniques is vital 
and even obvious. It is also obvious that all these factors must be 
adhered to in order to create^ operation and yet defi’^r 
full measures , of .quality and quantity to the consumer* It is fiirther 
obvious that ,.frp|n.. the,.,. producing, shipping, selling, -'and 
buying vievTpoints ,. we mst have accurate, scales and scalers. !| 

But perhaps not so obvious is ..the extent.^ the confusion th^rt 
can result frpm. errors by scale operators who 

function at differen-{;, sj^ages of product processing within a plant. 

Let us create a hypothetical example, but one which is familiar 
to all of us, albeit in different garb for each plant or industry. 

jj 

For purposes of illustration .we shall b^^^ c,qncerned ,.wit^ |product 

"x" (coming from Department "A") and its "shrink". This is thq^loss 
in weight iiiherent in normal evaporation of sitrface moistur or;[actual 
product loss, while "x" is being processed for 2k hours in Department "3*1 
Let us further, assume that the standard specification for .this ;lpss or 
shrink, agreed upon after much operating experience, is 1.0^ or, less. 
Upon this standard shrink ..is .based, among other things, normal oper- 
ating costs, inventories, and profits. [ 


then say that product "x" originates in Department "A" :^nd is 
weighed as it leaves "A" for Department "B", where it is processed for 
214 . hours and , finally weighed, as it leaves Department "B". ThqSj 
shrink % figures for product ”x" (which has a standard specified, shrink 
of 1.0^) is the ratio: ij ^ 


FIGUHEII 

weight at "A" - weight at "B" 

weight at "A" 


( 100 ) 


On the day we are studying the process, let us assume thai| we 
have a irysterlous insight into the true facts and these true fa|cts are 
that a 600# batch of product "x** leaves .Department "A'* and, aft^jr proc- 
essing in Department “B” weighs 59U#. Thus a loss of 6# in processing 
gives us the standard specification .of . 1»0^ shrink. . jj 


TIGDRE III 


600# - g9U# 
600 # 


( 100 ) 


6 

600 


( 100 ) 


1 . 0 ^ 
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Now that we know the true facts, let us go back and see xdiat 
problems can arise under certain operating conditions* 

Our scaling operator at the outgoing scale of Department 
reads his batch scale slightly to the top of the hairline due to some 
inherent, but incorrect, bias and reads the original batch weight as 
601# (only 1# over the weight we know to be a true 600#). Now the 
product with its 6OI# batch weight tag goes to Department *•3'^ and after 
2k hours processing is weighed ty the scaling operator in This 

latter scaler reads the after-processing weight as for he prides 

himself on reading a little low just to be on the safe side* (This is, 
after all, but 1# below the $9k# true weight that only we know of.) 

Now these figures are rushed to our plant accounting department 
and a shrink figure is calculated. 

FIGURE IV 

(100) . i (100) . 1.33* 


A shrink figure now has been arrived at that is 33^ over our 
standard specification shrink of I.OJK, which is what we know to be the 
true correct figure for the day*s run. If this situation occ\irs daily, 
which it well might, a long chain of events will be set in motion, all 
based on a shrink figure ^ich is not the true, and correct, shrink 
value. Some of the immediate consequences of this situation can bes 

1. The accounting department must take this 1.33^ figure 
as actual repeated performance, leading to* 

2. An expensive time consuming investigation of Depart- 
ment so as to check for defects in equipment, andt 

3* A strenuous conference between the plant superintendent 
and *»B*> personnel. 

But the most serious of all these consequences isi 

U* Product dost is increased in paper, which in turn must 
lead to loss figures for Department ”B*^ and/or an in- 
crease in selling price of product *»x** which may price 
it out of the competitive market. 

Now, remember that all of the four consequences listed above are 
based on a succession of two weighing errors - errors that are not 
dishonest on the part of the scaling operators involved and yet errors 
that can unleash a aeries of harmful, and needless, events. 

\tiSLt can we do to assure ourselves a minimum of such scaling 
variations? >fe have found the following, rather prominent points, 
essential in eliminating such situations* 

1. Use of the most accurate and durable scales available. 

2. Regular preventative maintenance and frequent checks by 
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well- trained scale specialists available at all time§* 

In our plants a specially trained scale mechanic is 
assigned to a specific set of plant scales. 

3* Adequate numbers of spare scales to act as substitutes, 
while repairs are made on original equipment. 

U. Training sessions for plant scalers so as tP tea.ch 

approved techniques,, as well as to point out the causes 
of possible inherent blM* llie chain of consequences 
resulting from inaccurate scale readings should be " 
included in this training. 

5. Periodic and unannounced checks of scaling readings ^ 

test personnel mth immediate correctipn of any devia- 

tions found. 

6. Careful attention given the semantics of each problem. 

Now why do we concern ourselves with a, situation w^ 
so acutely conscious of how close an operator reads the scale to the 
nearest mark? Let’s look,.. at the PPpnorid.cs a moment, 
we’ll say this product, is, selling at $6^ per pound and we are handling 
1500 such lots daily. 

FIGURE V 

1^00 X $0^ X 601 = jfi4.?0,000 paid for product 
at X% loss 

1^00 X X ® net worth 

at 1.33^ loss 

l500 X X 592 « UhUjOOO net worth 

Net $ 1^500 loss in excess. of standard 

I^Jhen a figure such as this is involved, we can readily see the 
importance of the size of the initial .discrepancy that will invariably 
initiate the chain of consequences touched on previously. 

Other specific applications of a quality control nature have '' 
involved the factprs p,f ' semantic^^^ as well as the allied 

element of savings. In all instances, we have regarded our respon- 
sibility as primarily educational, in that the programs after s-oxi^j 
and training stages have been turned oyer, to the operating departments 
concerned. The technical personnel responsible for surveys and plant 
training were sent ty our Research Department to both elementary uud 
advanced S.Q.C. courses at Iowa State and Purdue Universities. 

One product survey was primarily a single-plant program aimed ^it 
(1) reducing excessive overvxeights in consumer-size packages while 
holding underweights to a minimum, and (2) controlling products apd 
package appearance to a desirable standard. To these ends, after' 
training courses were given to plant scalers and inspectors, individual 
operator control charts, were used as a basis for sheets to 
management which pin-pointed operators and/or scale defects, as well 
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as improvements in scaling and packing* 

As a '‘second-check”, a weekly shipping room audit was made by- 
supervisors . Money saved by controlling overweights paid for the 
inspectors salaries, and we accrued the additional benefits of vir- 
tually eliminating underwei^t complaints as well as acquiring in- 
creased sales due to improved and consistent package and product appear- 
ance* 


FIG. 3ZE 

Before weight After 

control program 



Of a similar nature as to points covered was a program begun on 
a line of products produced in six major plants that included consumer- 
sized packages as well as institutional bulk items* 

As an example of incoming inspection, we ha-ve a sequential sam- 
pling plan in regular use on a product container that insures minimum 
production line stoppages due to faulty “empties”, as well as assurance 
against consumer complaint due to container imperfections* 

We have only touched on the far-reaching impact of semantics, 
“scales”, and ”sa-vings”, in our business as well as yours* Perhaps 
your industry measures where we scale; but be it calipers, micrometers, 
metering, or electronic analyzers, the same principles apply in the 
gauging of process accuracy. Perhaps you refer to an outside diameter 
tolerance or an upper chemical limit where we discuss length of slice, - 
you may speak in ten thousands of an inch, we in 1,000# batches, but 
regardless of the industry, the same immutable principles apply and the 
consequences, and benefits, extend to dollar savings, consumer satis- 
faction, repeated and new sales - up to the very continued existence 
of the concern in todays competitive market* 
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QUALITY COJTEROL FROM BERCa TO 

Frank H. S<li^ires 
Topp Industries; Inc. 

Statistical quality control; or more commonly^ quality control, is 
an ascetic among industrial techniques. Calm, aloof, detached, faintly 
academic, it appears to move through the clatter of the machine shop and 
the organized confusion of the assembly lines like a visiting professor. 
Concerned only to bring light into the unanalyzed darkness, it appears 
incapable of arousing emotion. " 

And yet it has aroused violent emotions, ih and in the car- 

peted offices on mahogany row. It has had the. effect of a bull, in^ a 
china shop without ever feeling like one . It has gone into the big in- 
dustrial shops like a good Samaritan, mounted on an abacus instead! of a 

horse and it has been received vath suspicion and occasional resistance. 

■ ■ ■ ■ . , ■ ■ . 

Why can something so innocent cause so much exci tenant 
isn't as innocent as it appears: it is more than a set of statistical 
techniques .... it is a challenge to the emotions, to the intellect, and 
to tradition. 

It is this challenge on all fronts which makes quality control the 
tremendously interesting profession it is and which creates the d^^ 
culties I V7ant to describe. •; 

On the bench, in the machine shop, quality control engineers >eek 
to install those excellent t^^^ v/hich appear to be self -evidently 

good and desirable. But they are resisted and sometimes rejected.' 

What goes wrong? There has been insufficient preparation, apd the 
failure to prepare is caiased by a lack of understanding for the parti- 
cular problems of the shop and the relationships which exist between 
inspectors and production operators. 

Consider an inspector in the machine shop, a skilled . machini|t „^d 
set-up man promoted to inspection. A quality control engineer is, sent 
down to the shop to install Shewhart control charts, Eiigineer and in- 
spector meet to discuss the saipe problem, but they don't speak th# same 
language — they approach the problem from different angles, and in next 
to no time there is mutual eX0'Speratidn! ' 

The inspector's entire experience has taught him to see the parts 
piece by piece, each a distinct and separate identity. As a machinist 
he once labored over each piece with equal care. He was occasioneully 
distressed by unaccoxmtable variations but he did not doubt that ^ 
effort on his part v;6uld produce identical parts. 

The first clash occurs when the quality control engineer turns im- 
patiently from the inspector's careful demonstration of a defect iand 
asks, ’'how frequently does it occur?” The very phrase has an alien 
sound amidst the oil and noise of the machine It is the first in- 

dication that the engineer does not "see” the individual piece, except 
as a small and insignificant sample of the group. This becomes ipore evi- 
dent as the conversation continues and the engineer presses for the pro- 
cess average quality level in recent lots, or for information from 
which it might be computed. 
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The engineer shortly reveals that his aim is to control the process 
so that the probability of making defectives will not run higher theui Vjo 
or l|^ or whatever quality level is established. This may be a far high- 
er yield of good parts than the process has ever given but the quality 
control engineer's willingness to settle for an;^hing less than perfec- 
tion shocks the inspector. The inspector and the machinists he works 
with have always had only one aim: perfection! Although it is never 
achieved there is great virtue in the effort and an equal virtue inrthe 
continued hope and expectation. By contrast it seems almost immoral to 
abandon the search for perfection and to become reconciled to "second 
class" goals like 995o; or even 99*9^ good. The engineer is familiar with 
and accepts the concept of the imperfectability of human effort; the in- 
spector isn't; and doesn't; and neither does the vast majority of man- 
kind. 

There is the matter of "judgment" or "common sense." An inspector 
operates under the protection of those powerful and popular labels when 
he considers the possibility of accepting parts which do not quite meet 
the specification. He may do this because he believes , from his know- 
ledge of the end product; that the slight discrepancy will do no harm; 
or because he believes the tolerance on the mating part will compensate 
for it; or because he has seen similar discrepancies accepted in of- 
ficial engineering review in the past; or because he knows the paort to 
be "the best" the man and the machine can produce. The tendency to 
award high marks for effort and to take the position that a man's best 
ought to be good enough is not confined to inspectors. It is another 
universal human trait and the individual who intends to challenge it 
must prepare a powerful case. The quality control engineer challenges 
it without being prepared and is surprised by the resentment that flares 
up. The engineer is unprepared for what he will find; the inspector is 
equally imprepared for what is expected of him. Furthermore; the change 
of procedure; almost iSo*^ out of phase from what he has been doing; is 
proposed to him by a stranger on his own ground, which is adding insult 
to injiiry. 

The inspector will be required to comprehend a new procedure, the 
setting up and maintenance of UT and R charts. These require some know- 
ledge of mathematics; no matter how simple the working techniques are 
made. He is going to be required to let the job run when he knows 
there is a probability it is producing some small fraction of discrepant 
parts, which challenges his sense of propriety. Most unfortunately he 
is going tc have to surrender the exercise of "judgment” and "common 
sense" as these are commonly understood in the shop and be guided by 
careful measurements objectively recorded on the control chart. From 
having been the all-powerful shop oracle he is to become an attendant 
for an inanimate control chart, or so it seems to him. 

The inspector is confronted with a direct intellectual and emotion- 
al challenge. He must learn something relatively complicated and he 
must surrender jealously guarded power. 

The intellectual challenge should not be presented on the floor at 
all. Inspectors should be thoroughly trained in their use before con- 
trol charts appear in the shop; it may thus develop that the inspector 
will become the explainer, the expositor of the new technique and will 
discover an emotional satisfaction akin to the exercise of power. 
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There are other solutions for serious difficulties hut 

the battle is already half won when the .^^ality control engineer ; is 
aware of thejn and. approaches them with sympathy and understanding. 

BUDGET 

It would he e^qpected that an austere objectivity and a frigid re- 
gard for the facts would dominate the negotiations for a quality 'control 
budget. Hot at all! here also there are ei^tihhih overtones an^ the 
occasional dash of conflict between current needs and traditional at- 
titudes . 

Every quality control administrator has learned t3iat his 
portant duty is the preparation of the budget, "selling" it to general 
management and keeping it sold. 

He must be prepared to explain convincingly why the allotmeht for, 
quality control should be set at a certain figure. He will have^^to meet 
frequent proposals to modify it, to rationalize it, to reconsider it, 
all of these being euphemisms for "reduce it." 

The limited enthusiasm for quality control budgets can be e;jq)lalnedj: 
there are two strikes against it before the budget conference opbns . 

Strike one: Quality control is labeled indirect or non-productive 
in accounting terminology. 

Strike two; Quality control was largely identified with inspection 
and. the identification has. stuck. . 

Accounting terminology has enshrined relationships which existed 
between the. various .departments of an organization at the beginning of 
the centuiy 

In those by -gone days products were simpler and industrial ;prgani- 
zations less complex. In the Victorian period one can imagine the dimly 
lighted factory, the rows of manual workers bending over benches;' and ma- 
chines; the owner in a stovepipe hat stands at the end of the sh'pp, 
counting the finished products coming off the end of the line. :She 
Wells Fargo Express is waiting, ready to rush them to all parts of the 
country at breakneck speed. 

There were no complications, the workers got their wages arid the 
owner got the tax-free profits. 

V/hen the business got bigger, the owrier*s daughter-in-law dame in 
to keep the books. The manual workers’ might then have baen 

termed productive, and the daughter-in-law’s non-productive. ratio 

of non-productive to productive work was obviously a very small pne. 

This tiny ratio becarae a precious legend. 

Times and products have changed Products of incredibly increased 
complexity and precision are being t-urned out in quantities beyond the 
wildest dreams of the stovepipe hat. These products require thousands 
of hours of preparatory engineering, production and inspection planning, 
the expenditure of great fortunes in machine tooling in order to; reduce 
the actual manual labor to a minimum. Without t^ preparations and 
without their continuous support the raw material would rot and ’'rust and 
machines and men woiold stand idle . 
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The manual labor content has dimini shed tremendously and the indi- 
rect increased accordingly ^ but the memory of those early days lives 
on. That almost prehistoric ratio is rememibered with anguish ^-^en mo- 
dem ‘^non-productive ” departments present their budgets. 

We are heading into automation vdiere the required amount of manual 
labor will shrink almost to zero and still the beautiful legend lives 
on. Hordes of engineers and programming attendants will wait on the au- 
tomated machinery and the ratio of ’’non-producers’* to "producers” will 
become astronomical. 

Since the real work vdLll already have been done by the engineers 
and planners (as it is to a large extent even now), all that will re- 
main for "direct labor” will be to push the button. 

It would emphasize dramatically the profound change which is taking 
place to allow the owner’s davighter-in-law to push the button. 

This charming person will then have moved from the numerator of the 
ratio to the denominator and will finally stand the beautiful legend 
con^letely on its head. 

The second strike against Quality Control is its early identifica- 
tion \rith inspection. 

In the late *20*s and early ’30*s when Walter Shewhart’s statisti- 
cal quality control procedures made their first appearance in industry 
they were put into the hands of inspectors. The intent of the quality 
control proced-ures was to prevent the manufacture of defective parts. 
Quality control was to be an integral part of the production plan, its 
particular aim being high productivity and a planned elimination of 
scrap. But inspection was popularly recognized as a sorting operation 
which went into effect only after the production job had been finished. 
In fact, it was said that inspectors neither designed the product, nor 
made it, nor sold it, but only rejected it. 

This was a most unfair appraisal of inspection but it had a popular 
vogue and, because of the close association, quality control was simil- 
arly stigmatised. 

Time has modified this attitude somewhat but not entirely. From 
the bench to the budget the Quality Control Administrator must be sensi- 
tive to the emotional climate; he must remember that the traditional 
view of "indirect" or "non-productive" labor and the effect of the early 
identification with inspection are inherited from the past and have 
therefore, in many eyes, a certain validity. They can only be dispelled 
by constant demonstrations of the productive character of quality con- 
trol. Sympathetic understanding is the watchword for the quality con- 
trol engineer whether he is making an installation in the shop or pre- 
senting a budget to general management. 
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ON SOME OF THE NECESSiffiY ®aElE®IENTS OF 
STAnSTICAL STMDARDS OF SAMPLING 
By 

W* Edwards Dendng 

Graduate School of Business Adntoistrat^ 

New York Itoiversity 

WHEN IS THE RESIM OF A SAMPLE ACCEPT ABIE? The basis for a!: sta.- 
tistical standard is statistical theory, good statistical practice, 
careful execution of the instructions for sampling and for the testing 
or for the interviewing, agreement on the meaning and limitation^ of 
statistical calculations, and usage* Statistical theory and practice 
have arrived at a stage where there is universal agreement on ceiftain 
practices and interpretations. For example, any two competent statis- 
ticians will agree that certain sample designs, if carried out, 'id.ll give 
results that possess valid standard errors. They will agree that other 
procedures will not do so. Moreover, they will agree on the calculations 
of the margin of sampling error for a stated probability, and on . the 
amount and kind of knowledge contained in the standard error. 

The margin of sampling error of a prescribed sampling procedure 
refers to the margin of difference, for a stated probability, between 
the result of applying this sampling procedure and the result of an equal 
complete coverage of the same frame. An equal complete coverage is a 
coverage of all the sampling units in the same frame that the sample w^s 
drawn from, carried out with the same inspectors or interviewers, with 
the same instruments and definitions, same procedures, and with the same 
care as was exercised m the sample. 

A good sample picks up samples of good work and of careless work, 
of correct measureiwsnts and of incorrect measurements, of correct re- 
sponses, incorrect responses, nonresponse, mistakes, all in about the 
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the same proportions that would appear in an equal complete coverage. 

Actually, as is well known, the result of a sample, especially for 
a study that is difficult, is for many purposes demonstrably more reli- 
able than the result that an actual complete count would give. The 
reason for the difference, when it exists, lies in the superior workman- 
ship that is possible in a small sample. However, superior workmanship 
in either a sample or a complete count does not just happen: it requires 
knowledge of the snaterial, knowledge of how people perform their duties, 
knowledge of theory, skilful planning, and directed effort in the train- 
ing and in the supervision throughout the job, 

FRSCISICK DOES NOT GUARANTEE USEFUINESS, High precision (small 
standard error) in the result of a survey or experiment only means that 
an equal complete coverage of the same frame would give very nearly the 
same result as the sample gave. However, the usefulness of a result 
depends not only on its precision, but even more basically on whether 
it extracts information that leads to new knowledge, or is a real help 
in the solution of some problem. Highly precise information that we 
can not use is little comfort. 

High precision does not imply (a) that the frame was complete or 
relevant to the problem, nor (b) that the method of test, or the ques- 
tions or the method of interviewing were relevant, nor (c) that the 
performance on the job was good. 

In more detail, we note that the result of any survey or experiment, 
v/hether by a complete coverage or by a sample, can only refer to the 
frame, which is the material presented for study. The frame is not 
necessarily the universe, which is the material that one really wishes 
to know about. Unfortunately, in many problems, any frame within reason- 
able cost will fail to cover a portion of the universe. 
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It may be important to note that, in a state of statistical contro,!^ 
the frame (material manufactured) may be taken as a random sample of the 
universe, and that objective inductions may be made by the theory of ^ 
probability from a sample of the frame to the production process ’ that 
created the frame, and hence to causes of variation or to causes of the 
level of quality. 

The test of a frame is this s if an equal complete coverage of all 
the units in the frame would be acceptable scientific or legal evidence, 
and if it would furnish a useful result, then a sample from the same 
frame would also be acceptable evidence, and would be useful, provided 
the precision of the sample is sufficient for the purpose. 

This answer does not tell us “what frame would fiumish us^e^^ 

suits, nor what information about this f ram© i"^ 

does answer a very important question about sampling. It throws the 

biirden on tP the equal complete coverage, and on to the experts in 

subject-matter, where it belongs. 

Confusion between (a) the universe and (b) the frame; and between 

(c) the precision of a result and (d) the relevance of the infoiijnation 

derived from the prescribed method of test or of interview, have been 

responsible, I believe, for a great deal of misguided counsel in; 

respect to the uses and misuses of data from both samples and complete 

coverages. This paper aims to clarify some of these points, and to put 

• ■ ■ ii - ■ ■ 

the responsibilities where they belong, 

WHAT ARB T® INGRES A GOOD SAMELB? Strict adh^enge t^^^^^ 

theory of probability in the sample-design, such as the use of random 

numbers in the selection, is a necessary ingredient, but this is not 

enough to ensure useful results. We must build into the survey or 

e^qperiment, in addition, certain other ingredients, which must ccm© 
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from (a) knowledge of the subjectHnatter (chemistry^ physical science, 
production, law, accounting, sociology, marketing, etc*) or from just 
plain understanding of human nature and of the relationship between 
product-design and the consumer j (b) careful execution of the sampling 
plan; and (c) measures of the nonsampling errors, and an evaluation of 
their possible effects on the accuracy of the results derived from the 
sample. 

The statistician with his theory is helpless if the company that 
he works for prescribes tests or questions that will yield information 
of little use, or if the employees of the company are careless in carry- 
ing out the work that the sample-design calls for* If a company or a 
client depends on the statistician and on statistical theory to take 
over responsibilities that only the company or the client can discharge 
through knowledge of their own problems and through substantive knowledge 
any survey or experiment may too easily turn out to be a disappointment. 
There are many ways to fail. One way is to fail to achieve as much good 
information as would have been possible with better planning# 

The statistician and the company or client that the statistician 
serves have well-defined responsibilities, and it is dangerous to ex- 
change them or to get out of bounds. The most important step in the near 
future toward better statistical work in industry will be better undei>- 
standing of these responsibilities. I have learned in my own practice 
that it is important to tell the client at the outset what are his 
responsibilities to the job, and what mine are. A code of professional 
statistical service may be based on what follows# 

The reason for stating these responsibilities explicitly here is 
(a) to enhance the usefulness of statistical theory and practice; (b) 
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to forestall disappointment on the part of the client, who if he fails 
to exercise his responsibilities in the planning of the survey oil' ex- 
periment, may not realize in the end its fullest possibilities, or may 
discover too late that certain uses that he intended to make of the 
results are impossible, 

RESPI^SIBILITIES OF THB STATW^^ I shall in what follows use 

the word client for simplicity, but what I have to say applies 
well to the relationship between a statistician on a salary and the 
company that he works for. 

The statistician's responsibility in any survey or experiment is 
only for its statistical aspects; specifically; 

a. to design a sample of a specified material, covered 
by a specified frame, to reach a desired degree of precision; 
or to design an experiment, to reach significance in the t.ests 
of specified materials or methods or types; 

b. to explain to the supervisor in charge of the work 
the instrucjtiphs for the selection of the sample and for the 
computations; to satisfy himself that the supervisor under- 
stands the instructions and the possible effects of departures 
therefrom. The statistician should make it clear to the client 
at the outset that he has the privilege of withdrawing frpm 
the engagement at anytime if he feels not satisfied with^ the 
client's performance on the job. 

c. to design a plan for probes of the execution of l^he 
work, to detect and to measure the extent of the possible non- 
sampling errors of chief importance (listed in some detail 
later on under the heading ”The statistician's report or 
testimony"); 
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d* to construct upon reguest of the client statistical 
aids to supervision, to improve the uniformity of the tests 
or of the interviews; 

e* to explain to the client, when the tabulations are 
finished, the meaning of the results of the survey in terms 
of their statistical significance* However, the statistician 
will not recommend that the client adopt any specific adminis- 
trative action or policy. The uses of the data obtained by a 
survey or experiment are in the end entirely up to the client* 

The sample-design will define the sampling units. It will explain 
how to classify and number them, and in some designs, how to thin one or 
more of the strata. It will contain instructions on the computaticai of 
the estimates desired, and of their standard errors. The selection of 
the sampling units for the sample will at every stage be made with 
random numbers. The statistician will furnish these numbers, or infill 
prescribe definite rules for the use of a table of random numbers, only 
after the client certifies that the preparation of the frame, including 
the scheme for giving a serial number to every sampling unit, is complete. 

The design of a sample or of an experiment calls for skilled use of 
statistical theory, coupled with knowledge of men and of materials. 
Judgment and knowledge of the subject-matter, so vital in their place, 
can not design samples nor experiments, nor select the sampling units 
for test. The statistician must be firm on this point* 

RESPONSIBILITY OF THE CLIENT. The client should state in advance 
how he expects to use the results of the survey or experiment. Other- 
wise, no proper statistical design of a survey or experiment is possible. 
It is the responsibility of the client to decide whether the information 
that he needs can be elicited at all from a sampling unit in the frame. 

If not, no survey, complete coverage or sample, will be satisfactory* 
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The development of the plans for a survey or experiment may require 
experimentation and trial, vdth successive revisions. The client ^ 
carry out the statisti(dan|s instructions for these explorations, 
will make the calculations therefor, with no changes in procedure With- 
out authorization* 

The plans, when finally fixed, should be in writing, and the client 
will make no changes in procedure without authorization so long a^ the 
statistician’s responsibility remains in force. This places a responsi- 
bility on the statistician: he is subject to call night or day, and he 
may, in his Judgment, need to make frequent enquiries about the work* 

The client should arrange for the statistician to have dir ec^^ 
access at any time to the people that carry out the preparation the 
sample, the testing or the interviewing, the supervision, and the 
computations* 

It is essentiiy. that know in advice what portion, or 

classes of the universe any proposed frame covers, and how thoroiighly, 
and what it does not coyer* The responsibility is the cliffs to 
cide whether a proposed frame and supplementation if any are sufficient- 
ly complete for his purpose. The test is whether a complete coverage of 
the frame would suffice# 

The client and not the sta^sti must assume the responsibility 
for those aspects of the problem that are substantive. Specif ic^pJLy, 
the client must: 

a* decide the type of information that the survey or 
the experiment is to elicit 

b. prescribe the methods of test, examination, question- 
naire, or interview by which to elicit the inf 
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The client must assume responsibility for: 

c* the decision on whether the frame is sufficiently 
complete 

d* the statement of the classes and areas of tabulation 

e* the actual work of preparation, training, testing, 
interviewing 

ft the supervision of such work 

g. the completeness of coverage 

h. the coding 

i* the tabulations and the computations 
The statistician may of course work with the client in these 
matters, but the ultimate responsibility for settling them is the 
client •s. 

THE STATISTICIAN *S REPORT CE TESTIMONY, The statistician's report 
or testimony concerning a survey or experiment will include the esti- 
mated standard errors of the results of chief importance, the calcula- 
tions of significance, and their statistical interpretation. It will 
include also information derived from any probe that he requested for 
measurement of the nonsampling errors, such as: 

a, failures to select the sampling units in the manner 
prescribed 

b, failures to reach and to cover sampling lanits that 
were selected or should have been selected 

c, the inclusion of sampling units not intended for 
the sample but covered or partly covered by mistake 

d, other slips and departures from the prescribed 
sampling procedure 

e, errors and difficulties in reporting 

f, nonresponse 
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These errors are measurable by observations on a properly selected 
subsample of the main sample. The statistician's report or testimony 
should include an evaluation of the possible effects of any such 
blemishes on the conclusions drawn or to be drawn from the data. 

It is interesting to note that measurement of the nonsampling 
errors is as important in a complete test or census as it is in a 
sample. In a complete census, the nonsampling errors are measured by 
a sample of a few thousand small segments of area, re-covered by expert 
interviewers. Verification procedures by a sample often turn up amazing 
discrepancies and omissions in so-called 100 per cent tests and 4iUditB* 

The statistician's report will not urge any specific decision upon 
the management of the company on the basis of the results of the sta- 
tistical study* This responsibility belongs to management, whicii may 
be in the possession of information not provided by the survey. -More- 
over, no decision can have the objectivity of a statistical result. To 
urge a certain decision on the basis of the results would be to (|p.oud 
the results of the stirvey* 

The statistician's responsibility carries with it any writing that 
may appear in print with his name attached in any way as a paHiqipant* 
There should be an understanding that the client, if he prints or pub- 
lishes the statistician *s report, will print it in full, and will not 
omit any part of it without the consent of the statistician. 

There should be no necessity, with the adoption of statistical 
standards, to present in legal evidence the theory of sampling, nor the 
details of the sample-design that was used, provided it was a prpbability 
design. The standard error, and the number of degrees of freedom in the 
estimate thereof, plus some relevant measure of any serious departure of 
the distribution of the estimate from normal convey all the infoxmiation 
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that there is to convey in respect to the margin of difference, for a 
prescribed probability, between the sample and an equal complete cover- 
age. Knowledge about the details of the sampling plan adds no new in- 
formation about the sampling error in a result# 

Measures of the nonsampling errors add a great deal of information 
about the accuracy of a result. We may thus conclude that the only 
relevant evidence about the accuracy of a result is a statement by a 
ccaapetent statistician (a) that the sampling plan was in fact (or was 
not) a probability sample of a certain frame; (b) that the margin of 
error for a prescribed probability (e. g. IJ^ in the upper tail) has a 
certain magnitude; (c) that probes of the execution of the sampling 
plan revealed certain departures or no departures from the plan pre- 
scribed; (d) that in his opinion these departures if any will likely 
cause, certain inaccuracies in the results, which he will evaluate and 
describe. 

A statistician *s certificate could well be a paragraph that de- 
scribes the sampling plan simply as a probability sample drawn up accord- 
ing to standard and accepted theory and procedures, followed by nota- 
tions of exceptions and their possible effects. The sampling plan and 
the frame or frames, and all pertinent details, should of course be 
available for probe if any question should arise about the execution of 
the plan, or about any part of the plan itself. 
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MANAGERIAL STATISTICS 

Alex G. Nagy 

Lone Star Brewing Coinpany 

I. General 

The importance of the BMagement fimction in busj^es^ afe^^ 
has grown tremendously during the twentieth century. This development, 
which has he^^ particularly phenomenal during the past generatibn, has 
come about as l^e reiul^ pf the gigantic growth of industry. The size 
and coB 5 )iexity of bixsiness organizations h^^ necessitated ah increasing 
amount of attention to fqimiUatipn of plans, budgets, and administrative 
control operations . The owner •operator of a small bvMSlnoss coi^ possess 
firsthand knowledge of details of his entire operation. This Is not so 
with businesses owned by numerous stockholders, guided by boards of direc* 
tors and managed by staff executives, none of whom can become intimately 
acquainted with the. multiplicity of details cpncerning sales, production, 
Inventories, finance, personnel, euad a(toinistration, . 

In discharging their managerial functions business executifeis 1^ 
departments have become increasingly dependent upon accounting and sta^- 
tistics . 

Managerial statistics deals with date a^ methods which arp useful 
to management in planning and controlling organizational acti>4tieB. 

PLANNING is the first step in scientific management. All plans are 
based on forecasts. Formally or informally - knowingly or unknowingly - 
businessmen are xpaking forecasts when they purchase raw materials, when 
they purchase plants and equipment, when they engage personnel, in fact, 
whenever they perform any act in anticipation of the future, 
men cannot avoid m ak ing forecasts, they can only neglect to make as in- 
telligent a forecast as possible. True, the most certain thin^ about the 
future is its unpredictability. However, some aspects of the future can 
be predicted more reliably than others. The reduces the 
likelihood of error in his forecasts by carefully estimating the future 

impact of those factprs which can be forecast with t^ degree of 

accuracy. f 

ADMINISTRATIVE CONTROL. Well-for^^ of little value 

if they are not effectively carried out. It behopyes the business execu- 
tive to exercise administratiye control in an effort to 

correct controllable deviations from planned operations. For cxsmplSj 
the trend of sales by products, territories, and salesmen is hjghly 
significant information. Executives imist to capitalize, on 

favorable sales trends and also to adjust to unfavorable trends . Simllar- 
ly> production costs should be subjected to critical analysis . ' Lack of 
control of production costs can easily result in a loss rather 'than > 
gain from business operations. Reduced costs increase unit profits just 
as surely as do increased selling prices. 

II. Use in the Brewing Industry 

Table 1 compiles some of the aspects where stetistics tevi been u^ 
successfully. All these activities are part of or related to forecast 
and internal control^ the two major fields of application of mfi^agerial 
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STATISTICS HAS BEEN APPLIED 
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TABLE 1 
































statistics 


A, Forecasting 

To aid loanagement in planning, data to be collected, to be tabvilat* 
ed, to be analyzed and evaluated may be summarized briefly as follows: 

1* Factors affecting beer demand: 

A, Population 

-population trends 
-age group development 
-wet and dry issue 

-population by sales districts 
-characteristics of popialation 
-number of farm homes 

-number of people engaged in maniifactur ing 
-industrial development 
-Latin-Amer lean labor migration 

-race 

-geographical distribution of 
-White 
-Latin 

-Colored population 

B, Disposable Income 

-average effective buying power 
-by sales districts 
-per capita 
-per family 

-cost of living index development 
-economic development 

C, Price of Beer 

-distributor prices to retailer 
-by packages 

-popular vs premiun priced beer 
-profit structure comparison 
-on distributor level 
-on retail level 

-effect of taxation on price, and related to per 
capita consumption 

2. Inter-industry Competition 

A. Economic Importance of the Brewing Industry 

B* Effect of Competitive Industries 
-liquor 
-wine 

-soft drink 

C* Prohibition Sentiment 

3 . Intra-industry Competition 
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A. The Whole Brewing Industry 

-beer sales* trends 
-package movement 
-seasonal indices 
-number of breweries 

-methods of acquiring more brewing capacities 
-development in rank of sales 

-the place of a regional brewery in the industry 
-local advantages 
-purchasing disadvantages 

B. Local Beer Sales 

-factors affecting local beer demand 
-local beer sales* trend 
-out-of-state vs local brands 
-package movement 

-effect of dry territories on package movement 
-pricing effect on packages (pop\ilar vs premium) 
-brand comparison analysis 
-by brand, by package 
-by geographical distribution 
-effect of beer sales reporting regulations on 
the reliability of analysis 
-market evaluation 

-geographical distribution of market potential 
-buying motives 

-brand preference 
-package preference 

The above information, supplemented by the brewery’s own operational 
data then becomes the basis for the sales forecast, regardless of whether 
management is using an intuitive or a mechanistic approach. There are 
many books published on forecasting, and they suggest a number of alter- 
native methods of procedure. The most widely used methods are: 

(1) correlation and regression analysis 

(2) curve fitting or time series analysis. 

Many coD^anies place substantial reliance on sales forecasts by salesmen 
and by surveys j thus using 

( 3 ) sale smen * s opinion 

(4) consiamer surveys 

The newest methods combine the wisdom of experienced businessmen with 
statistical analysis in the 

( 5 ) filter technique 

(6) skeptic's technique 

Let me summarize the advantages of a sound forecast: 

a. Successful budgeting of expenses, costs and profits de- 
pends on good forecasting of sales income. 
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b. Successful forecasting reduces the area of aygidabie 
Forecasting will seldom, if ever, be without some error; 
but forecasting can limit the area in which guesswork is 
the only guide, 

c. Gk)od forecasting can stabilize production and employment 
over the years by ironing out variations caused by seasonal 
fluctuations of sales. Steady employment can mean ihetter 
labor and community relations, lower employee turnover and 
lower labor costs. 

d. Better forecasting will be needed by management tp ;deal 
successfully with the growing rigidities of labor Costs aiid 
other problems brought about by the demand of organized 
labor and public opinion, 

e. Satisfactory control of inventory of all kinds — bf swing 
raw materials, packaging materials, beer in aging Snd 
finish tanks -- is dependent on satisfactory forecasts of 
future sales. Successful planning of long-term investment 
programs and of corresponding new capital requirements de- 
pends on reasonably accurate long-term forecasting ‘of sales. 

f . The successful use of stanj^rd pg^s^^^ for cp$t and 

expense control, and for satisfactory pricing of products 
depends on good long-term forecasting of sales and ^pro- 
duct ion volume. 


B. Managerial Control 

The making of decisions is.. in.. a sense... both..,. the, ,,fir§t^^^^^ 
step in a cpntihuing, never-ending, dynamic managerial control process. 
Ideas for the cgnduct gf a bu^^^ are^^^OT evaluated, decided 

upon, and put into effect. The resulting action is then appraised in 
terms of the objective to be attained, expressed as greater revenue, as 
lower cost, or otherwise. Thie appraisal gives rise to a new proposal, 
an adjusted program. Further plans and decisions are adapted to new 
needs and changed external circumstances. 

The need for control, in this sense, is of comparatively repent de- 
velopment. This need grows directly out of the delegation of auihority 
and responsibility characteristic of modern, large-scale enterprise. In 
small businesses control is effecteC^ direct observation and super- 
vision, and by the personal knowledge of the owner or manager and his 
contact with each individual transaction and aspect of operationa. This 
knowledge and contact of top executives is not possible in a lar^e organ- 
ization, although it is present, to a degree, in the lower ranks! of man- 
agement. Top executives must nevertheless supervise the actiyltles with- 
in their respective Jurisdictions despite lack of personal and direct 
contact with events and personnel. This supervision is accomplished by 
the delegation of authority and responsibility to lesser executiyes and 
by the introduction of other means; of mnagerial control in substitutipn 
for the direct knowledge, contact, and action that are no longer 'possible. 
The new agencies of control that are now necessary introduced are the 
carefully formulated and predetermined objectives, policies, plans, pro- 
grams, standards, and cost system. These instiruments are not 
exclusive and independent; rather, they are interrelated phases of mana- 
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gerial effort to secure and maintain control under conditions of dele- 
gated authority. 

Control, as the word is used above, may be applied at all levels of 
the organizational structure and to all phases of operations. 

All too often accounting records are maintained solely to provide 
data required for payrolls, customers* accounts, and for reports to stock- 
holders, creditors, various regulatory bodies, and the Internal Revenue 
Service. 

A brewery *s accounting records should be geared to its organization- 
al structure in order that data drawn from the accounts may readily re- 
flect the degree to which executives and supervisors have discharged 
their responsibilities. Accounting systems designed on a responsibility 
basis yield data required by nonmanager ial groups, and in addition, 
facilitate preparation of reports reqiiired for internal administrative 
control . 

Accounting and statistics have been long recognized as primary tools 
of the business administrator. To be siire, accounting is much more firm- 
ly established than is business statistics. Nevertheless, increasing 
recognition has been given to the importance of statistics, and the re- 
lationship between accomting and statistics has become more evident. 

This was noticeable first in the development of cost accounting and more 
recently in the shift toward responsibility or managerial accounting, in 
which accounts are used to provide data to measure executive or depart- 
mental accomplishments in relation to some desired standard or level. 

Business administrators require a variety of reports which often can 
be obtained only from several classifications of the same data. For ex- 
ample, management often desires reports on sales classified by package, 
territories, salesmen, and distributors. The cost of maintaining a set 
of accounts which would provide directly all such classifications would 
be prohibitive. Rather, primary classification of accounts should be on 
the basis of responsibility; required secondary classifications may be 
obtained easily by the use of electric or manual sorting device. 

Analysis of trends of profits, sales, and expenses by various perti- 
nent classifications may be described as a function of either the ac- 
countant or the statistician. The important point is that whoever makes 
such an analysis should be well grovinded in both accounting and mana- 
gerial statistics. The area where statistical analysis can substantially 
extend the scope and penetration of accountants* services is in the field 
of aid to management. 

C. Application of Statistical Control Techniques 

BUDGETARY CONTROL; Forecasts of sales - formal or informal - 
serve as the foundation for plans of future business operations* Inte- 
gration of all phases of a brewery *s operations to the sales forecast 
may be accomplished by budgeting. A budget may be thought of as a plan 
for future operations expressed in financial terms; actually, this re- 
quires that plans first be expressed in physical terms, such as units of 
sales, production, and number of personnel. A complete and integrated 
budget plan would probably include the following budgets; 

Sales budget 
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Inventory budget 
Production budget 
Purchasing budget 
Various expense budget 
Capital esqjenditure budget 
Financial budgets 

The close relationship existing among the above budgets is ,, quite 
obvious* However, budgets to be effectiye, must be realistic, ilThey 
must also be subject to more or less constant review. Wben the|pccur-; 
rence of unpredicted events changes forecasts, corresponding revisions 
must be made in the budgets. The unpredictability of the future does not 
destroy the value of budgeting. On the contrary, budgeting familiarizes 
executives with the relationships among the several phases of a brewery’s 
operations and thereby enables them to adjust operations more readily to 
meet changed conditions . 

All budgets may be reduced to control charts, thus providii;ig depart- 
ment heads with a simple line graph, enabling them not only to follow de- 
velopments by the month but also by comparison to any past periods 

Prom a managerial point of view there is one very important aspect 
that I would like to emphasize. Accounting records may reveal the per- 
son responsible for any mistake or losses; but the mistake need" not have 
been made if he had been cautioned in time. Setting up pre -determined 
control limits on charts advises department heads of this caution before 
their action goes out of control and thus will eliminate mistakes and 
losses. Control limits could be determined by the same techniques used 
in quality control, or by management decision. 

SALES CONTROL: The purpose of sales control is to determine the 
difference between actual sales and budgeted sales at any given period 
in order that operational plans may be adjusted accordingly. Since gross 
income and consequently expenses are budgeted according to sales, per- 
formance level analyses are of utmost importantance . Package movements, 
geographical distribution of potentials, difference of sales between 
sales to distributors and distributors V sales to retailers shpujd be cq^^ 
tinuously evaluated. 

INVENTORY CONTROL: Inventories Pf stock should bq adequate to meet 
sales but should not be excessive. Lack of inventories means Iqss pf 
sales, but excessive inventories mean not only that capital is "frozen'* 
or idle and not earning any return, it could result in some old" beer 
either at the distributor’s warehouse or in a retail outlet. 

Control charts for each package may be set up indicating in units 
the sales to distributoirs and their sales to reM pharts 

will show two important features: 

1. seasonal movement differences 

2. inventory movements in the territory 

Sales, inventories, production, and purchases must be geared together if 
maximum efficiency of operation is to be realized. 

PRODUCTION CONTROL: Brewery's production control is twofold: quali- 
tative and quantitative . 
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The production director or brewmaster is responsible for the uni- 
formity of the beer produced, paclcaged and distributed. The brewing 
quality control program was the first department in the brewing in- 
dustry to make use of statistical techniques in brewhouse as well as 
bottle shop control. Some breweries have extensively used statistics in 
vendor rating and taste panel evaluation. 

The brewmaster *s efficiency is judged not solely on quality of the 
beer produced, but also on how economically he can produce it. Effi- 
ciency could be achieved by: 

1. producing as much as can be sold 

2. controlling manufacturing costs 

Both of these factors may be set up on charts. A continuous five year 
chart indicating production, forecast, and actual sales by month, by 
package; supplemented with a product ion- sales -inventory chart should give 
adequate information for short-run adjustments. Significant from a cost 
point-of-view are the bars representing over and \mder production. Co- 
ordination of production to actual sales and vice-versa achieve the most 
economic and efficient operation. 

Manufacturing cost may be set up on charts by using unit cost as 
follows ; 


For Brewmaster: Manufacturing cost 

-brewhouse and cellars 
-bottle shop 
-power department 
-overhead 

For Brewhouse: Total cost 

-raw materials 
-labor 
-power 
-overhead 

For Bottleshop: Total cost 

-packaging materials 

-labor 

-power 

-overhead 

On these basic charts all uncontrollable changes, such as increase in 
price of raw material, new labor contract, etc. may be indicated. This 
technique may be applied to any phase of operation which need to be ana- 
lyzed further, such as composition of raw material and packaging material 
costs, cost of different packages and lines. 

Comparison of manpower production figures with those of similar size 
breweries, both at brewhouse and bottleshop level, could foster efficiency. 

EXPENSE CONTROL: Expense budgets should be supplemented by the use 
of e3Q)ense and performance standards for as many expense items as possible 
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Actiial expenses and performances shquld^^^b^^ regularly with the 

expense budgets and standards. This enables e^ tp teke rem© 

action whenever significant differences occur, f: 

Expenses, such as shipping and delivery, selling, advertisii% and 
administrative, predetermined by the sales forecast, may be set df 
control charts on a $/bbl. or unit sold basis. Using a semi -log "paper, 
the slant of the line will indicate tte tr^ change month by mbrith. 
Management may determine control limits for the total expense by 'depart- 
ment which also could be carried on the s^e chart, 

FINANCIAL CONTROL: A thorough analysis of sales and expense;s will 
enable a brewery to construct a break-even chart. Such a chart illus- 
trates the profit or loss which, will result at various volumes of sales 
over a period of time, provided expenses are controlled according to 
plans, and provided significeuat fluctuations do not occiir in prices of 
material, labor, supplies, and finished goods. Incidentally, this same 
technique could be used for determining the distributors break-e'ien point. 

Other charts used in financial control: 

-geographical distribution of income vs expenses 
-effect of taxation on income dollar 
-analysis of stockholders by size of holding, sex, geo^l 
graphical locations 

REPORTS CONTROL: Internal administrative control is largely depen- 
dent upon preparation and analysis of reports on all phases of operations. 
However, a burdensome reporting system can easily defeat the purpose for 
which it was intended, namely, effective managerial control, Data should 
be reported only if they serve a specific control purpose; data |hould 
not be collected merely because they are "interesting^' or becaus| they 
might "come in handy sometime." Remember: !; 

1. Measure only what is measurable 

2. Measure only what is in^ortant 

3. Keep it simple and accurate 

h. Use it as a tool not a substitute for judgment^ 

III. Conclusions 

Statistical techniques are almost indistinguishably interwoven with 
accounting and reporting techniques in the area of managerial control. 
Statistical techniques which have useful applications in control;: include 
measures of central tendency, measures of variation, ratios, percentages, 
index numbers, trend analysis, correlation and sampling. Althou|h mana-, 
gerial control involves much more tha^ the application of statistical 
methods, it is difficult to conceive of an area of control whqre^i some 
statistical technique could not be employed to advantage. 

Administrative and statistical controls, properly designed, high- 
light essential information which otherwise would remain foreyer;;pb— 
scured in the mass of detail which necessarily characterizes accbvinting 
records , 
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AN APPEQAOH TO THE 

Jack Mazmion 

Northrop Aircraft^ Incorporatod 
The CcinsuaaiSBIttPpnerJ^ Xntrodttotifln 

Tha operating principle of our vast ii^uetriUl coiiqplex: placoj^ nearly 
every organisation in the field of Buyer^eller Rei^ for nearly 

all muet buy and all mast c^rtaii^ sell* 

Individual organi 2 sation 8 have expeiKl^ considerable effort reduce 
the principles of the buyer^seller relationship to a regularised system 
subject to equitable control* There has however^ an iij^ustsry” 

wide effort to provide fleodble spltltipna to recuiflring 

problems of Ix^h buyer and seller* 

Some of the past sork has h|ui reparably useful results and 'has 
provided a base of experience upon idiich more ambitious structi^ may 
be built* For example, eiqperience has proven the value of Vendor Cer- 
tification apd Its prerequisits of an acceptable quality control pro^am 
in the Vendor^s plai^, the necessity that a vendor practice statls^lPPl 
control methods j and the requirement that the yeo^or ent er^^^ 
into a certification agreeiment^^ 

Most such certiflcatipn plans also include provision for the clas- 
sification of characteristics, the standardization of l&apection m^^ 
aiii the reduction of inspection severity based on acceptable quality 
history* 

All of these factors have proven valuable and most have 
tensively documented so tlmt f^ comnmnt need be made here* 

Another k^ effort is currently being expended in a 

cooperative effort between ASQC Electronics Division popu- 

larized explanation of the meanings and the application of Quality 
Control techniques to the buyer-seller relationship. 

One of the most recent dayelopiinent 8 in the Vendor-Vezides relations 
field, and the one essentially responsible for the writing of this paper 
is the formation of the ASQC Veiklor^-Vendee Relations Committee. ^Thls 
Committee was permanently organize in 1956 under the oo-chairma^sbip of 
E* C. Bennett of J^o^hrop Aircraft, Incorporated and W. R. Pabst; of 
Ordinance Proving Ground and consists of about 20 xoiembers equally divided 
between Iiidustry and the^^M^ ' 

The Committee operates as an organized body for the direction of 
task force teams assigned to the delinitloh of particular facets of the 
PiH)ducer-ppnsim3«r This paper presents a plan idiic^ was 

originally developed to provide better quality assuranpe and tbs’ achieve- 
ment of measurement compatibility, but grew to the point where believe 
it can help solve a number of the problems faced by both Producer and 
Consumer. 


First, let us exeunine some of our problems from the viewpoint of the 
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consumer* 


What^ for esoeuaple, shall be the basis for our decision with respect 
to the severity of receiving inspection control? In the airframe in-> 
dustry, as in others, we can classify the vendor ^s product in accordance 
with our ability to verify its quality# 

Firsts and least difficult to control, are those products which ex^ 
hibit fully verifiable quality characteristics* An example of such a 
product nd^t be an electrical stand--off insulator* The insulator must 
have a certain length, width, and depth; it must have a resistance such 
that it will not conduct current when a given high voltage is applied 
across it* The acceptability of this part can be fully verified provided 
we can simulate its use environment during receiving test or can calculate 
the part*s behavior under its use envix^onment* 

Second, and the most difficult to handle, are those vendor products 
whose quality characteristics cannot be fully verified short of de&^ 
tructive testing, if at all* This category would include sealed and/or 
functional items and some chemically processed parts* 

We have, for example, several electronic packages which we purchase 
that require a functional test in Receiving inspection* Due to the fact 
that they are designed and built by a vendor and then sold to us as a 
’’black box’’, no real analysis of the assembly short of environmental 
testing is possible during receiving inspection except the measurement 
of the outputs when the specified inputs are applied* 

We also purchase printed circiiits the conductors of which are made 
up of copper, nickel, and rhodium - stacked up in that order* If the 
rhodium plating is done properly, we have no way of knowing that the 
nickel plating has been applied properly unless we destroy the conductor* 

Actually there are a lot of things in this receiving inspection 
business 'idiich you must ’’take on faith”, and the trend should be toward 
the elimination of some of these ”articies of faith” by improving the 
communication between the user and the producer* 

However, even ^en we can determine the quality status of the 
vendor’s product, our ability to obtain correction of unsatisfactory 
conditions is, in part, dependent upon the level of control we are able 
to exercise on the various soiirces of product* 

Most amenable to control is our own, the consumer’s, pro** 
prietary product* For such product we control the specification 
and we may usually select the producer, but the problem lies in 
effective comnunication and the cost of adequate control on the 
part of the vendor* 

Second, with respect to controllability, is the Military 
Standard or Ixxdustry Standaxxi part* Here we do not control the 
specification directly, but we help make it* We do have, however, 
a rather large number of vendors to select from which is the real 
&ovroe of our contsrol* Again the pitfall is the specification in- 
terpretation, but here also enters the economic problem faced by 
the vendor who provides better conformance through increased control 
effort and thus runs the risk of pricing himself out of business* 
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The next category incluides the producer*e proprietary product* 
We have no contz^l of the specification and the producer 
ly sell all ha makes* problem here is one of cosnsunic^jtipn - 
we to understand what the product will do he to \n4e^^ what 
it must do* P\irchased quantities have an influence here* . 

Last and least controllable, from the viewpoint of the con- 
sumer, is Government Finished Equi;^ Here long chamois 
of comBunication and a generalized specification work against ef- 
fective corrective action. On the pt^^ ^satisfactory 

product, when issued to a rnmober of contractors, has the singular 
effect of widespread pressiare and sometimes resets in effective 
corrective action. 

In the past, industry has generally employed a process of Rafter 
the fact’^ correction to its jrei^ It has made extensive use 

of liaison methods in an effort to aptdeye an acceptable mutual under- 
standing of requirements* It has perform^ selective inspection and 
often simply stretched the acceptance criteria when the product was bad- 
ly needed. But usmlly it has just rejected the product over apd over 
again* 

Recently, however, there is evidence of spme really enlightened 
thinking in the direction of general solutions for many of the fendor- 
Vendee ?el#tipns problems* Certainly Industry is better analysing itp 
product requiremmt 8 and, with the help of the Vendors, better Speci- 
fications are being written* Wore cooperative relations with Vendors 
are being actively and logically pursued, and the producer's peibformr 
ance is being nkore accurately and objectively evaluated* 

We, as the consumer, must extend these efforts and we must, provide 
for a more clearly defined interrelation of the facets of our i*plation- 
ship with our suppliers* We must extend and still fuHher dql^e pur 
requirements* We must establish better organized methods of indoctrina- 
tion and communication between ourselves and pur vendors* We must learn 
to help the vendor distritnite ^s control effort in accordance |with our 
requirements for his product* We must rate all of our suppliers fairly 
and accurately, and we must pay special attention to the establishment 
of conqpatibility of measurement between oiirselves and our suppliers* 

We believe the plan devised at Northrop will provide a solution to 
many of the problems we Jmve discussed* 

The Elan 

The plan is comparatively simple in operation but rather l^rpfd 
in scope and flexibility of application* 

- It provides for unusually efficient use of variables;: sampling* 

- It achievpa a maxiim^ of possible control over the 

various pr^uct types previously mentioned* 

- It provides for assurance of measuren^nt and inspection method 
compatibility* 

. ■ ■ 

- It makes possible both short long term correlation of dis- 
crepancy and performance da^* 
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It rates vendor perfoarmance fairly, accurately, and auto- 
matically* 

Here then, briefly, is how the plan operates: 

The first step is the full analysis of the product we intend to 
receive paying particular attention to classification of character- 
istics, acceptance criteria, and qualification requirements* 

The establishment of characteristic classification is based on 
the following considerations, each of which is classified Critical, 
Major or Minor and from which a summary classification is determined - 
also Critical, Major or Minor* 

- The importance of the vendor^s product to our end item* 

(i*e. What will be the result of failure to the safety or 
performance of the end item?) 

- The importance of the individual characteristic to the 
vendor »s product* (i*e* Will discrepancy or failure of the 
characteristic cause the vendor ^s product to fail?) 

- The probable reliability of the manufacturing process for 
the individual characteristic* (i*e* What is the probability 
that the vendor *s manufactiiring process will produce an 
error?) 

- The risk factor of error detection subsequent to receiving 
inspection* (i*e* Are we likely to find €ua error before 
next assembly or inspection?) 

- The economic consequence of an erx*or escaping detection duiv 
ing receiving inspection* (i*e* Is the part buried in the 
airframe or scattered in stock bins all over the shop?) 

The acceptance criteria, the AQL, the inspection methods, and the 
Inspection tooling requirements for each characteristic are predeter- 
mined in accordance with measurement requirements and a summary 
classification of each characteristic* 

The qualification test, first article inspection and/or pilot run 
inspection requirements, over And above normal acceptance procedure, 
for significant quantities of product are predetermined to insure 
acceptability for characteristics suspected of being marginal* 

The vendor »s contract is then arrived at by negotiation to insure 
that full understanding of classification and acceptance criteria is 
achieved* In addition, the vendor is apprised of other requirements 
as necessary* For example, the vendor may be required to submit 
certain variables data with respect to characteristics classified 
"critical”, or we may stipulate specific requirements and methods of 
accomplishment of corrective action and the establishment of measure- 
ment compatibility* 

When the classificatiotB have been accomplished and the contract 
negotiated, the inspection procedure is determined* The resulting 
inspection plan is described by means of a form called a Quality 
Evidence Record, one of ^diich is used for each part type* The form is 
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the inspection instruction sheet ani is J^le^ appropriate^ re- 

ceiving area# Prior to receipt of product^ the form vill be filled out 
with the following information: 

- Identification of the vendor and part* 

- Classification of the characteristics and their associated 
AQL»s* 

- The inspection tooling requirements* 

- A merit value for each part udiich is merely a count o4! the 
part characteristics to be inspected regardless of 
cation* The merit value is constant regardless of lot size 
since errors on a few pieces in a lot constitute a grater 
risk to the consumer than errors on pieces* There is 
also the factor of error propagation in that a single dis- 
crepant condition tends to permeate an entire lot* The 
merit value also measiu:*eSf to some extent, the consmoir^s 
opportunity of detecting a discrepancy* 

The Quality Evidence Record has the additional virtues of i^oviding 
a guide for the inspection and a visual indication of historical be- 
havior for the part he is inspecting* The format is such as to indicate 
at a glance any repetitively discrepant characteristics* 

The received parts are then inspected to the established pl^ and 
the inspection results for the part number are recorded on the Q*E«E* 
under the corresponding characteristics* (See Figure 1) 

lidhen the vendor has suboiitted certification data on Qritipil 
characteristics (see Figure 2), variables sampling or l66^ inspection 
may be employed, and the results of the inspection compared to the 
vendor*s data* Ihis provision considerably’ increases the asauimce 
to be achieved from variables data, both from a product acceptability 
viewpoint and from an ey^uation of measurement compatibility* 

Accepted parts and lots are desi^^iated, for tabulating purtoses, 
by the simple addition of the pazt^s merit value to the standard 
Receiving Report form which also contains ths usual identification and 
quantity data* ( See Figure 3) 

In the event of rejection of one or more P^krts, another stlhidard 
form is utilized, the Receiving Rejection Report* (See Figure 4) 

This form normally lists hecessaxy identity and quantity data but 
disi^ys, in addition, the merit value for rejected parts and t|e 
specifics of the rejection, such as: 

- The kind of rejection is reported - such as visual, fijihcticMml, 
dimensipnal, etc* 

- me letter classification of the discrepant characteristic. 

This classification has been predetermined as previously 
mentioned*. 

- A numerical seriousness index associated with the lebler clas^ 
sificatipn of the characteristic* The numerical codes are 

'i ■ 
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applied Xsy the receiving inspector and are determined in accordance with 
the following definitions: 

Code 1 - A discrepant condition which with reasonable certainty 
will cause the inspection characteristic to fail* 

Code 2 - A discrepant condition which does not cause immediate 

failure of the inspection characteristic , but which ^ if 
not corrected, would develop into a Code 1 condition. 

Code 3 - A discrepant condition which will probably not cause 
failure of the inspection characteristic at present or 
in the future. 

Each discrepancy type will receive a demerit rating, depending on 
the combined letter and number code, as indicated in Figure 5 * Vendor 
reported errors will receive 1/2 the expropriate d^erit rate because 
of the reduced risk inherent in preknovledge of a discrepancy. 

When the receiving inspection function is completed, parts are 
dispositioned and handled through normal channels, and copies of the 
receiving forms ^doich have been generated are forwarded to tabulating. 
Tabulating keypunches the information and provides a tape which cata- 
logues automatically all transcribed and computed information concerning 
the performance of each vendor on a lot by lot basis. (See Figure 6) 

The tape includes: 

- Complete identification of the vendor and the part. 

- Complete recording of the rejection data including kind, clas- 
sification, quantity, and vdiether vendor reported. 

- Ihe merit/demerit performance ratio for each lot. 

- The number of lots received and the lot rejection rate for 
the time period. 

- A summary control rating, determined from the vendor ♦s lot 
and piece performance. This is the control figure upon 
which is based the vendor review decision. 

Once the data have been keypunched, the tabulating function is 
automatic. It permits Porting by any item or combination of punched 
data as well as an accumulation of information for any time period 
desired. (See Figure ?)• It also permits, through the use of effec- 
tivities, determination of the effedtiveness of corrective action. 

The above described system is really quite simple and culminates 
in a useable ratio for the determination of a vendor *s performance. 

The summary rating is the device idiich initiates vendor review action 
when necessary and functions as such except in the case of an Al, A2, 
or B1 coded discrepancy which require immediate action regardless of 
the vendor *8 sunmary rating. 

Conclusion 

In summary, some of the pertinent features of the plan might bear 
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further mention: 

The use of vsriehies sampling is especially valuable in that jLt 
permits comparison of the vendor average and rmge 

with those determined by ourselves, as well as the detectipn of m^lrglnal 
design characteristics, and variation due to tine, storage and hariijdling* 
This feature provides for simultaneous ^lysis of the compatibility 
between the measurements resulting from the respective inspection ;|sys- 
tems« 

The plan requires the vendor to inspect in accordance >dth product 
usage requirements* 

The plan utilizes only existing paperwork and requires very little 
additional effort for its effeotiye usage* 

The plan is con^letely uniform with respect to all vendors, iind 
serves to reducf judgement factors in rating vendors* 

The plan provides objective quality evidence, gathered in category 
and quantity in accordance with the importance of the item. This ■■in- 
formation is of primary value in engineering development work* 
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ACiLs ARE HALF THE STORY 

Edv/ard R, Clark 

Detroit Transmission Diyision ;; 

General Hptors Corporation 

The initial setting of an A^L for acceptance purposes must, of 
necessity, be arbitrary because of. a lack of infonnatiqn on which ^*to 
base such a decision. Indeed, the determination of a proper AQL is one 
of the knottiest problems faced in establishing a sampling plan, Many 

companies have established standard AQLs for yaripus class if icaH pf 

characteristics or parts. There have been some rather complicated meth- 
ods derived for deterrnining AQLs, ^ 

This paper demonstrates a method , for eyalua^^^ the selected "AQL 
regardless of ho-vr it was. initially chosen. Several other points regard- 
ing the relationship of AC^Ls to incpining quality levels will be in|de. 

The optimum sampling plan is one which maxj^i?:e pf the 

customer at minimum inspection cost to the customer. As preliminary 
factors, these are extremely important, but any sampling plan mus| be 
reviewed periodically to determine its conpatibility with the q\ia|ity 
level of the material being submitted to it. | 

In the preceding discussion, references have been made to ”A§Ls'*, 

In most of the technical Quality Control literatur^> ’^he term AQL stands 
for “Acceptable Quality Level”, Mil-Std-105 defines AQL as “a nominal 
value expressed in terms of percent defective or defects per hundred 
units, 'whichever is applicable, specified for a given group of defects 
of a product”. The Supply & Logisties Handbook H 105 indicates t^at the 
Interpretation of AQL is sometimes made as the poorest tolerable average 
quality level of submitted product. Dr, Grant also establishes tfe^s 
latter concept of Acceptable Quality Level. In any case, it is evident 
that assignment of an AQL is the consumerls way of telling the vendor 
the average m^iximum amount of ^non-conformapce. h^^^ to acCept, 

In all of the literature, concerning Acceptable Quality Levels, itjis 
made equally clear that the vendor mwst dp the best job he can because 
contractual obligations either imply or establish the vendors V reipon^^^ 

sibility for conformance to specification on all parts. However, once 

an Acceptable Quality Level has been established or assigned, it is 
rarely reviewed to .deteimiine,.w^ realistic and irt|iether 

or not the vendor is .making a real attempt to improve the quality of" 
submitted product* 

In addition to the Quality Level, there are two ojbher 

AQLs that must be considered' in any evaluation of a vendor* s performance. 
These two additional AQLs are !i 

The Actual Quality Level 
and 

The Attainable Quality Level 

The Actual Quality Level is the vendor's performance over a Series 
of lots generally in terns of percent defective. It is often referred 
to as the process average. The term Actual Quality Level has beep sub- 
stituted to keep the importance of its relationship to the other ,|bwp 
AQLs clearly in mind, ^ 

The Attainable Quality Level is the level at which the yendop could 
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send in product if it were not for the presence of significantly inferior 
lots or inconsistent performance. It may be thought of as his process 
capability in percent defective* 

The three types of AQLs then, that will be discussed in this ex- 
ample are 

1* Acceptable Quality Level 

(lilhat the customer wants) 

Symbol : Acc QL 
2* Actual Quality Level 

(V/hat the vendor is doing) 

Symbol; Act QL 
3* Attainable Quality Level 

(VVhat the vendor can do) 

Symbol; Att QL. 

Tabulated below is a record of a series of 25 lots of the same part 
sampled and inspected. The Acceptable Quality Level is k*0% and the 
sample size was 250, The reject number is 20, 


Lot Mo. 

No. Defective 

% Defective 

Disposition 

1 

9 

3.6 

A 

2 

15 

6.0 

A 

3 

4 

1.6 

A 

4 

52 

20.8 

R 

5 

5 

2,0 

A 

6 

3 

1.2 

A‘ 

7 

33 

13.2 

R 

8 

6 

2.4 

A 

9 

13 

5.2 

A 

10 

6l 

24.4 

R 

11 

8 

3.2 

A 

12 

14 

5.6 

A 

13 

48 

19.2 

R 

14 

7 

2.8 

A 

15 

11 

4.4 

A 

16 

20 

8,0 

R 

17 

6 

2.4 

A 

18 

10 

4.0 

A 

19 

56 

22,4 

R 

20 

31 

12.4 

R 

21 

12 

4.8 

A 

22 

2 

0.8 

A 

23 

13 

5.2 

A 

24 

5 

2.0 

A 

25 

12 

4.8 

A 

This data has 

been plotted on 

a p chart in Figure 1, 


The Acceptable Quality Level of 4*0^ is sho'.m on this chart along 
with its 3-sigma Upper Control Limit, 

The Actual Quality Level calculates to 456/6250 or 7 *3% and is also 
shown on the chart with its 3-sigma Upper Control Limit, 

The Attainable Quality Level, calculated in the usual manner by dis- 
carding points out of control to the Actual Quality Level, is 2,8^ and 
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its 3-signia Upper Control Limit is also sho.vn. Note that Lot 2 is out 
of control to the Attainable Quality Level of This suggests that 

the Attainable Quality Level may be even somewhat lower than 2.^% but 
further calculation demonstrates no significant lowering of the 2*8;^ 
with the available data. 


This analysis raaj/- be sujimarized and tabulated as follows: 



% 

No. of Lots 0.0. C. 

Q.L. Consistency 

Acceptable Q.L. 

4.0 

7 

12% 

Actual Q.L. 

7.3 

6 

li>% 

Attainable Q.L. 

2.8 

8 

68^ 


This table of results also shows the number of lots out- of- control 
to each of the 3 Quality Levels and introduces, in the last column, the 
term Quality Level Consistency wtiich is the % of lots consistent to each 
of the various Quality Levels, Note that although there is considerable 
difference in the 3 AC^s, the consistency levels are relatively stable. 
This indicates that not only is the quality performance of this vendor 
inconsistent to the Acceptable Quality Level, but it is equally incon- 
sistent to his Actual Quality Level and to the inherent Attainable 
Quality Level of 2.8^. 

Statistics without action have very little practical value for any 
of us. It is necessary that the data compiled above becomes the basis 
for an effective plan of correction. It is clear that the inconsistent 
performance of this vendor is causing the submission of lots consider- 
ably in excess of the desired quality level. It is also evident that 
the vendor's process, is capable of producing at a quality level much 
superior to the originally specified Acceptable Quality Level. 

The first course of action, therefore, is to change the Acceptable 
Quality Level from 4.0^ to 2.8;;^ or perhaps 3.0^ if some standa3:*d samp- 
ling plans are being used. This alteration will best be represented by 
a reduction in rejection’ number from 20 to 15 rather than an increase in 
sample size so that the consumer is not affected in terms of inspection 
cost. Such a change in the sampling plan will result in an increased 
number of rejected lots unless action is taken with the vendor to im- 
prove the consistency of his process. 

Analyses of the performances of many vendors (or departments in a plant) 
will demonstrate that inconsistency is the most serious quality problem 
existent. In other words, the poor operation of a process is a more 
prevalent cause of poor quality than the process itself. Most of us in 
Quality Control have made process capability studies and have found many 
times that even though a machine might not be capable of holding a re- 
quired tolerance, it usually can be operated and controlled much better 
than it is. 

In order to effect the corrective action necessary,'- to make the 
vendor's submitted quality more consistent so that his Actual Quality 
Level will begin to approach his attainable Quality Level, a strict 
sequence of investigation is required to determine the assignable cause. 
This also occurs in sport. If a man is a 200 average bowler and he 
doesn't bowl 200 for several games, he is in a slump and -we begin to 
look for what he is doing differently. There is no sudden jump to the 
conclusion that he is no longer a 200 bowler. In the case of the vendor. 
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it is appaireht that he has not performed at a 2,3^ level, but it is 
equally apparent that he can & it. 

In order to detemine the cause for perforraancl, the 

follo«ring sequence of action should be followed: 

1# Determine, through a review of the records, ,vhich part 
characteristic defepts caused the inconsistencies 
represented by those points above the Upper Control 
Limit for the Attainable C,iuality Level# 

2. Review with the vendor each of these charac^ 

so that you and he are in agreement on what constitutes 
acceptability* ' 

3* Cage or otherwise evaluate a .SOTplo of parts for eacfii 
of these characteristics ydth the vendor so that he ^ 
has a clear iinder standing of your interpretation of ' 
the characteristic (Step 2) and your physical evalu-; 
at ion of it. 

4. Clearly identify the parts inspected in Step 3 and let 
the vendor take them t^ so that he may 

determine whether or not his people can make the ; 
same decisions on each part* Defective parts, accept- 
able parts and borderline parts ought to be in the slinple. 

5m Check to determine that his final inspection is at , 
least as tight or tighter than your*s and that it 
includes very specific reference to the inconsistent, 
defects. 

6, Finally, the vendor should follow back to 

that the production operators have a clear knowledge 
of their responsibility through a review of Steps 3 
and 4 with them* 

Correction should be made at any step found unsatisfactory. The 
goal of such a program is to reduce the inconsistency of perforrriiance. 
Ideally, this goal will be realized when 

Acc s ' Act QL a Att QL ^ ’ 

If these 3 levels are equal, any further reduction will only be 
realized through process changes at the vendor’s plant or engineering 
change at the customer’s plant. 

It is evident that this concept of ':*^uality Level Consistency can 
form an excellent basis for Vendor Rating in conjunction with tbe 


various AQLs. It is 

evident 

that 2 vendors producing the same i5art 

may compare like this 

; 





Vendor 

A 

AccQL 

4.0 

CjLC 

72 

Act QL 
7.3 

QLC Att UL 

TS 2.8 


B 

4.0 

88 

6.4 

96 6.1 

i 96 


Essentially, it appears that Vendor A’ s problem is consistency of 
running his process while B’s is the process itself. 
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The tightening of AQLs and improving the various acceptance plans 
adds to consumer quality protection but may seriously interfere with the 
consumer’s quantity schedule. The acceptance function of any Receiving 
Inspection activity must be coupled with a planned program of correction 
and prevention of defects for optimum performance. 
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SAMPLMJ BY VARIABLES It OWE-WAY Pi^TEGTlON ON X ' 

Max Astrachan 

Air Force Institute of Technology § 

The principles of attributes inspection along with tables and pro- 
cedures are well known and have been discussed in many places, tess 
well known, however, are techniques and tables for variables ihsiectich. 

It is the purpose of this series of four papers on sampling'^ by 
variables, sponsored by the AS^iC Committee on Education and Trailing, 
to discuss methods of constructing such plans, and the tables which are 
available in the literature. In the present paper, we consider the 
case of one-way protection on the mean, and show hov/ to construc-i; a 
variables plan in the case in which the product standard deviation is 
knov/n. 

In attributes inspection an item is classified either as del'sctive 
or non -defective, or we count and record the number of defects ip It, 

In variables inspection the characteristic in question is measured 
along a continuous scale in terms of inches, pounds, volts, seconds, 
etc, A decision relative to each piece inspected can be reached' by 
comparing the measurement with the lower specification limit and/or the 
upper specification limit. This disposes of individual pieces, '^Since, 
however, v/e want to reach a decision about a lot on the basis of exam- 
ining only a sample, this must be done by using information competed 
from the sample, i 

It is obvious that measurement of a qizality characteristic gives 
much more information about an item than merely classifying it ap de- 
fective or non-defective, or counting the number of defects in i|. 

Hence, variables inspection of a sample yields more information about 
the quality of the lot than does attributes inspection. Practically, 
this results in reduced sample sizes required for specified degrees of 
protection, and is the major advantage of variables inspection, ['It 
should be considered as an alternative, therefore, when the cost"' of 
inspection by attributes is high. 

Against this is the obvious disadvantage of the greater skill re- 
quired to make the measurement, the cost of tools and gages, and the 
time required to make the necessary calculations. The latter is^not as 
serious as would be supposed at first glance, however, since techniques 
have been devised for shortening them. 

The use of variables plans requires a rather strong assumption 
about the nature of the distribution of the quality characteristic 
under consideration, viz., that it be nofmal* The frequency distribu- 
tion of many measurements is roughly^ normal and hence from the practical 
point of view this assumption may be considered valid. However, ’^t 
should be checked whenever possible. Throughout this paper we sltili 
assume the normality condition satisfied. 

As in many other situations, the choice between attributes dnd 
variables inspection, if there is one, must be made on economic grounds. 
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We shall illustrate the method of constructing a variables sampling 
plan by the following example : 

Example 1 For a certain type of metal casting the lower specifi- 
cation limit (L3L) for tensile strength has been set at 55*000 psi* 

From previous experience it is kno\«i that tensile strengths of such 
castings are normally distributed with a standard deviation of 3500 psi, 
i.e., ^ » 3500, The variables plan consists of the determination of a 
sample size n, and a constant K, and operates as follows; 

a. Select a random sample of size n from the lot, 

b. Find X, the mean tensile strength of the sample. 

c. If X is greater than or equal to K, accept the lot; if not, 
reject it. 

Olearly, if the lot mean X* is large enough there willjbe very few 
castings with tensile strengths below 55*000 psi. Suppose X* = 65,000. 
Then the percent below the specification limit can be determined by 
first finding the normal deviate 

= ,.55,^0 0 0 ::.65, ,oo i^ , 3^ 

<r* 3500 

and then referring to a table of areas under the normal curve. We find 
that 0.21^ will not meet the specification. 

If the lot mean is not much greater than ^,000 psi, the percent 
of defective castings will be large. Suppose X’ = 6l,000. As above, 
then, 


isL - x» - 55*000 - 61,000 - ^3^ 

3500 

and from a table of areas under the nprmsil curve, 4«3^>o of the castings 
will be below the specification limit. 

Suppose then that we consider 65,000 psi as an acceptable quality 
level for Z* and 6l,000 psi as a re jectable quality level. With each 
v/e associate risks of rejection and acceptance, say = ,02 ;and/^ = ,06, 
respectively. This means then that the probability of rejecting lots of 
acceptable mean quality (Z* = 65, 000) is *02, and the probability of ac- 
cepting lots of re jectable mean quality (3C' = 6l,000) is .06, As in all 
cases, whether or not these quantities (levels and risks) are satisfac- 
tory must be decided by management, Since our test is a test on means, 
we shall be working with the distribution. of means, which we know is 
riormal. Figure 1 shows the distribution of T for SV • 61, 000 and 
X* =» 65,000 together with the corresponding o( and/^ • 
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Fig. 1, Distribution of X for acceptable and rejectable 
quality levels, and the corresponding risks and p .t 


To determine the values of n and K, we proceed as follows: “ ^ince 
we have agreed to reject acceptable lots (with X* = 65,000) 2% pf the 
time, we may write* 

-2,054 (1) 

3500 


Further, to accept lots of rejectable quality (with X* * 6l,000) 6^ of 
the time implies that* 


K - 61,000 

= ^US55 


( 2 ) 


The constants on the right in (1) and (2) are determined from the stand- 
ardized normal curve so as to give «( * *02 and/^- •06. 


* Remember that we are working here with the distribution of tHe mean, 
for which the standard deviation is 
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Subtracting (1) from (2) gives 


4000 

3500 

tn" 


3.609. 


whence 


4000 = 3.609 


^ = (3.609) (.875) = 3.16 


n = 9.99. 

So we would use a sample of size a = 10. (V/e always round our computed 
value up to the next integral value of n instead of to the nearest whole 
number . ) 

To detemine K, we may substitute n « 10 in either (1) or (2). 

Using (1) would leave at *02 but change/^ slightly, whereas substitut- 
ing in (2) would leave at .o6 but change c( sli^^tly. ViHiich we v/ould 
do in a particular case depends upon management. 


Using (1) v;e have 

K = 65.000 - 2.054^^ 


= 65,000 - 2.054(1106.8) 

= 65,000 - 2,273 
- 62,727 

To see what happens to/Cf , put this value of K in (2) to get 

62.727 - 61.000 „ 1727 - 

3500 1106.8 * ° 

fio' 


as the nomnal deviate, 

whence *0594 which is close to .06 because our computed value of n 
was very close to 10. Had it come out closer to 9 the value of/:^ v/ould 
have differed from .06 by a larger amount. 

Had we used eq^uation (2), the value of K v;ould be 62,721, ^ would 
remain at ,o6, and ^ turns out to be .OI98. 
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To sirnmariae then, our plan operates as follov/s: 

a. Select a random sample of 10 castings. 

b. Find X, the mean tensile strength of the siample. 

c. If X is greater than or equal to 62,727* accept the lot, other- 
wise reject it. 

If the lot mean is as great as 63,000 psi, the probability of ac- 
cepting it is 0.98* and such lots will contain 0.21%' castings with ten- 
sile strengths less than the lower specification limit of 35,000'' Psi* 

If the lot mean is as low as 6l,000 psi, the probability of accepting 
the lot is 0.0394, such lots will be 4«36i^ defective. 

To see how the plan operates on lots of other mean values, we con- 
struct its operating characteristic curve. The essential calculations 
are shown in Table 1. Goluitn (2) gives the normal deviate valuels for 
K relative to lot mean values in column (1) for the X distribution. The 
entries in column (3) are obtained from a table of areas under t|ie nor- 
mal curve and are the probabilities of accepting lots with mean yalues 
listed in column (1). The entries in coluEpn (4) are the normal deviate 
values for the lower specification limit in the distribution of Individ- 
uals, relative to the lot mean values in column (1). In column (5) ^re 
the proportions of defective castings (i.e. with tensile strengths less 
than 35,000 psi) in the lots of stated mean values in column (1). 


Table 1 Calculations for the OC curve for the sampling plan in;‘ Example 


1. 

(n = 10, K 

= 62,727) 



x» 

K - r* 
3500 

l/H- 

= area 

cL 

above z 
in (2) 

z » _ 

55,000 - x* 
3500 

Area below 
z In (4) 

(1) 

(2) 

(3) 

(4) 

C5? 

59.000 

3.37 

.0004 

-1.14 

.1271 

60,000 

2,46 

.0069 

-1.43 

.0764 

61,000 

1.56 

.0594 

-1.71 

.0436 

62,000 

.66 

.2546 

-2.00 

.022^ 

63,000 

- .25 

.5987 

-2.29 

.Ollp 

64,000 

-1.15 

.8749 

-2.57 

.0051 

65,000 

-2.05 

.9798 

-2.86 

.0021 

66,000 

-2.96 

.9985 

-3.14 

.0008 

67,000 

-3.86 

1.0000 

-3.43 

.0003 
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Probability of A.ooeptance, P^ Probability of Aeoeptance 




Figure 2 shows the operating characteristic curye for ihe plan, 
obtained by plotting column (3) against column (1). We can det^rxaine 
from the curve the probability of accepting lots of various mead 
if they are offered. In Figure 3 have plotted column (3) against 
column (5)* This curve shows the probability of accepting lots '‘of vari- 
ous incoming fraction defectives (fraction of pieces below 55* O^Opsi). 


To show how a variables plan can be constructed for the ca^ in 
which an upper specification limit (13SL) is given, consider 

Example 2 For a certain type of metal casting the upper specifi- 
cation limit has been set at 90,000 psi. From previous experience it 
is Imown that tensile s of such castings are normally distribut- 

ed with cr* = 3500 psi. We want to find the sample size n and ppnstant 
K so that our procedure will be as follows: ■■ 

a. Select a random s^ple size n from the Ipt, 

b. Find X, the mean tensile strength of the sample, 

c. If X is less than or egual to K, accept the lot, othei^ise 
reject it, 


Here vre v/ant to guard against the lot mean being too high rather 
than too low, as v;as the case, in the fir^^ Let us oohsider 

80,000 psi as an acceptable value for the lot mean, and 84,6o6 'psi 
unacceptable, with risks of rejection as c|f « #02, and of acceptance as 
= *o6, respectively. Then proceeding as in E:Jariiple 1, if JT* = 
8o,000, 0*21>« of the castings will be above the upper specification 
limit, whereas if XV = 84f000, will be uiiacceptable,’’^’ " 

'it r 

To find the values pf n ,and K, we set up the tv/o equations, analo- 
gous to (1) and (2): 

,. jLl . 82a° L » ^2.054 (3) 

3500 

fS' 

and 

K - 84,000 . .1.555. (4) ’■ 

' ^ ... 

■ ■ vs* . 

* These percentages turn out^to be the same as in 2^ 1 ohly be- 

cause of our selection of XV =^ .80,000 and X* = 84,000 as thp accept- 
able and re jec table values. We could, of course, have used‘| other 
suitable values. Using o( = ,02 and/? - ,o6 as before, also 'dupli- 
cates some of the following numerical, w 
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Solving for n, gives as before. 


4000 



whence 


n = 9*99 

and we shall use a sample size of 10* To find K we substitute this 
value in (3) to leave^^ unchanged* This gives 

K = 80,000 f 2.05it /^30o\ 

Km) 

» 80,000 f 2,273 

= 62,273. 

The value of , however. Is reduced to .0594 as in Example 1 . Had we 
used ( 4 ) to find K, its value would be 82 , 279 , would remain at the 
specified value of .06, butej* would be reduced to .OI 98 , 

Our procedure to deterraine the disposition of a lot then, is to 
first find the mean breaking strength of a random sample of 10 castings, 
If the sample mean is less than or equal to 82,273 psi, accept the lot, 
otherwise reject it. 


The attributes plan corresponding to the variables plans derived 
above would require a large sample. Thus, for the situation in Example 
1, each casting would have to be subjected to a 55 t 000 psi tensile test 
and rated as to whether or not it breaks* The use of the much smaller 
sample size in the variables test results in considerable savings in 
time and money. 


The use of the plan in Example 1 can be illustrated by throwing 
fpxar dice and noting the total number of dots. Since for four dice 
X* = 14*0 and • ■ 3*42. if we call each dot 1000 psi, we can simulate 
a population for which o** » 3420, which is close to our value of 3500 
psi. Calling the total number of dots observed on a throw as the number 
of thousands of psi above 50,000, for example, v/e shall be sampling from 
a population for which X* « 64,000. Rolling the dice n ■ 10 times 
should produce a mean which will be greater than or equal to oixr K 
value of 62,727* and thus lead to acceptance, about 87*5^ of the time as 
can be seen from Table 1 or Figure 2. Similarly, we can adjust X* to 
other values and try the plan. 


One other final comment might be made. Because of the relationship 
between the mean of a normal distribution and the fraction defective, it 
is possible to construct variables plans instead of attributes plans to 
control the latter. It is only necessary to convert from fractions 
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defective to corresponding values of X** Thus Example 1 could have been 
restated as follows: The lower specification limit on tensile strength 
is 55*000 psi. Design a variables sampling plan which will ha v| an AQl. 

= 0,0021, lot tolerance fraction defective p^ « 0 . 043 ^* ®f = 0,02, and 
/i = o,o6. 
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SAmiNG BY VARI/V3M5 , n TWO,,.Wn X* 

Fred C* Leone 

Case Institute of Technology 

In the preceding discussion we considered a variables sampling plan 
where the consumer was interested in a one way protection* We illustra- 
ted the exact nature of the plan by an example showing a step by step 
procediare for its cons tpyc^^Qn. Finally, we followed this withla de- 
tailed consideration of the operating characteristic 

Suppose we extend this idea to two sided protection * It i| not 
difficult to visualize a number, of cases where a product can hafe too 
high as well as too low a value to satisfy the consumer* s specifica- 
tions • Let us consider the problem presented in the earlier di|cussipn* 

For a metal casting both a lower and upper specification l|mlt have 
been prescribed* Suppose these are 55,000 psl and 90,000 psi respect- 
ively. Again assume that the tensile strengths are normally distributed 
with a* « 3500 psi* For the lower specification a lot with a mean of 

65.000 psi is considered to be acceptable quality* One with a pean of 

61.000 psi is of rejectable quality. On the upper specification this 
acceptable and re jectable quality is 80,000 psi and 84,000 psi respec- 
tively. As in the example presented in the earlier discussipn/'let us 
agree to have a risk of rejecting acceptable quality equal to *02 , and 
of accepting rejectable quality equal to *06* That is a * *02 ^d 

p * ♦06. Let this #02 and *06 be equally divided at both specification 
limits. This means a/2 « .01 and p/2 - .03 at each end* Graphically 
this can be represented as Figure 1. 



Fig. !• Distribution of X for Acceptable and Rejectable 
Quality Levels. 

Remember that the values of thp X ’ w®re partic 

ulAr percentage of the product was outside of the specification limits, 
To determine the values of K^, and h the foilowing 
used: 

K, - 65,000 

(1) — - 2.326 

3500/ Jn 
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(z) 


1,381 


^ 61,000 


5500/ >Jri 


Kp - 84,000 

(3) -= » -2,3S6 

5500/ >|n 


The constants on the right of equations (l), (Z) and (3) are determined 
so as to give a/Z « ,01 and ^/Z * ,03 from the standardized normal 
curve, A fourth equation which can be derived from the first three, 
and therefore is not Independent* of these, is 

Kp - 80,000 

(4) -= « 1,881 

5500/ ^[n 


Solving for n from equations (l) and (Z) we obtain 
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n « 15,6 

n • 14 (always rounded up) 

If we substitute n ■ 14 in equation (1) we get 

K, - ^ 65 000 

^ {IT 

p 6^,824 

From equation (3) 

g ^ 55 0 0 J~ g » 5 26j ^ 84.000 

^ gi4 

- 81,824 

This gives a * ,02, To determine the value of p, substitute the value 
of and n in the left of equation (2), The result gives us a value 

of z for the standardized normal distribution. The area to the right 
of z is then the calculated p/2, We do not expect this to give us 


^Equation (4) is obtained by subtracting equation (l) from the sum of 
equations (2) and (3), 



exactly p/2 « *05 since the value of n was rounded to a whole number. 
To continue 


, 62,823 - 61,000 . 

3500/^ 3500/JI4 

Therefore, from the normal curve 

p/2 » *0256 
and p - *051 

If instead of substituting n « 14 in equations (1) and (3) we ]|ad used 
(2) and (4) we would obtain i 

« 62,760 

Kg « 81,760 
with a - .017 
p « *06 

We now have a choice of two sets of and Kg, the first giving a • *02 

and p » *051, and the second with a « *017 and p « .06. The choice of 
one of these two is an administrative decision and need not coi|.cem us 
here. The former is more conservative, however. With the former pl^ 
the procedure is as follows: 

(1) Select a random carq^le of size 14 ■ ^ 

(2) Find the mean tensile strength of this sample, namely, X. 

(3) If X is between 62,824 psi and 81,824 psi accept the ||lot. 

Otherwise, reject the lot. 

This plan, then states that if a lot me^ is 65,000 psi or' 80,000 
psi the probability of its being accepted is *99 (that is, l*u/2) and 
such lots will have .21 percent of the castings with tensile slirehgth 
below 55,000 psi in the former case and the same percent above "a ten- 
sile strength of 90,000 psi in the latter case i If a lot mean "'is as 
low as 61,000 psi or as high as 84,000 psi the probability of ‘its being 
accepted is .0255 (that is, p/2) and such lots will have 4.27 percent 
defective . 

Consider now a modified example. A cylindrical part is produced 
for an assembly. The outer diameter is required to have an avqpage 
quality of ,4275 inches. If these parts are sampled we must be! willing 
to have a risk of rejecting good quality as well as a risk of accepting 
bad quality. Suppose we decide that lots with an average quality below 
.4270 in. or above .4280 in. are not desirable. However, we are will** 
ing to accept those lots of small pieces, say 10 percent of thel' time, 
and those of large pieces, say 10 percent of the time also, THjls is pur 
p, or the consumer's risk. On the other hand, we will agree say 

5 percent of the time we will reject lots of good quality. Thils is the 
a, or producer* s risk. Again, returning to the assuiiption of normality 
of the distribution of sample means, our problem may be displayed graph- 
ically as follows: 
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Fig* 2. Distribution of X for Acceptable and Rejectable 
Quality Levels. 


Assume that a’ is known and is equal to *0005 in. Our problem 
then is as follows: Given an acceptable quality level of *4^75, the 
lower and upper undesirable qualities of *4270 and *4280, and the 
standard deviation » *0003, how large a sample should we take and 
what are the lower and upper acceptance limits K, and for the aver*^ 
age of this sample of n pieces? We are willing to accept the product 
with a mean of .4270 ten percent of the time, and with a mean of .4280 
ten percent of the time, and to reject the product at average quality 
level equal to .4275 five percent of the time. K. Kp and n are the 
unknowns. The equations for the solution are: ' 


(5) 

( 6 ) 

(7) 


K, - .4870 

-i 1.288 

,0003/ ^ 


Kg - ,4880 
.0005/ ^ 


1.888 


K, - .4875 

-= - 1,960 

.0003/ ^ 
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The foairth equation, which can be derived from the first th^ 

- .4275 

(8) -1.960 

. 0005 /^ 

Solving: for n from equations (5) and (7) we obtain: 

.0005 - 5.242 

>F 

^ “ 5.242 X .6 - 2.00 

n « 4 

Substituting n » 4 in equation (5) and then i 

« .4272 
Kj^ « .4278 

As a check, determine the a for an acceptable quality level of .4275 
and acceptance lower and upper limits on the sample mean of o427g and 
•4278 respectively. This turns out to be .05, The reason a is almost 
exactly the value originally required is that there was essentially no 
rounding off of the exact value ^ to obtain an integer* 

In order to see the effectiveness pf„,t^ in accept- 

ing good lots and rejecting poor ones, we construct its operating char- 
acteristic curve* Table 1 gives the necessary calculations for points 
on the_^curve. Note that column (1) gives the various values of the lot 
mean, X’ • The values of and in the columns (2) and (5) respec- 
tively give the normal deviates for values of Xi. Column (4) gives the 
probability of acceptance of a lot whose mean is specified in column 
(1) • These probabilities are obtained from a table of a;n®;as^,M 
normal curve. 

The operating characteristic curve of the above plan is given in 
Figure 5. In this the abscissa is the true mean X* in inches obtained 
from columri (l) of Table 1. _The ordinate is the probability of accept- 
ance of a lot whose mean is X*. 


The above procedure could be employed for a sampling plan where 
the AQL, p^', a and p are specified and the tolerance limits are- given. 

Again, a’ is assumed known and the distribution. Is asstuned normal • For 
each of the tpleranpe. lim^ the lower and upper tolerance meari;s are 
computed and we proceed as before. 
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Table 1* Calculation for the OC Curve for the Sampling Plan 
in Example Z (K^ »AZ7Z, *,4278, n * 4) 


- X' K - X' ^(aoe)- 

X» a„ » areas between 

•0003/^ *0003/^ Zj^ and 



(in inches) 


Fig* 3* Operating Characteristic Curve for the Double Limit 
Sampling Plan n « 4, « a 4272 and * *4278, 
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It should again be stressed that a variables sairpling plan rieq^ii*es 
smaller sanple sizes than an equivalent attribute sairpling plan* ■' This 
is evident from the fact that in variables ^ore than just 

”good" or "bad” is assigned to each item tested* At times one may not 
have a choice between attribute or yariables saii^ling* But if a meas- 
urement can be taken on a quality characteristic of an item, and espe«» 
c tally if the cost of testing is expensive, then the variables sampling 
plan will, in general, be more advantage ous^ 
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SAI4PLING BY VARIABLES III - gRQTEGTION ON VARIABILITY 1' 

Gayle W. McElrath Jacob E. Eearman;. 

University of Minnesota University of Minnesota 

INTRODUCTION: ' 

Basically, the disposition of a lot which is submitted to a vari- 
ables acceptance procedure depends on one of two common quality cHteria, 
VJhen the quality being tested is measured, the question may be (l) is 
the lot different from a standard level ^ has it excessive v^ri-r ... . 

ability. Most often the acceptance criterion is based on the level of 
lot quality. However, occasionally, the criterion of process vataability 
is the necessary quality characteristic for acceptance. This papier 
concerns itself . .with. the la T 

A few examples will help realize the problem. 

1. Machine tools might not operate successfully if the; 

shipment of bar stock varies too greatly. ;; 

2. Time standards require a certain measure of cpnsistr 
ency of performance rating among different engineeii^S. 

3. A problem of balance might require that a set of n, 
objects do not have too great a variability in weight. 

' ■ 5 | 

ii. Matching painted panels requires that the characterlr 

istics of the surface finishing do not vary too grektly. 

5. The variability in weight of specific units to be jj 
packaged must adhere to given specifications around 
a specified average. 

6. The variability of the life of n tubes in an eledtrphic 
device m\ist not exceed a given value in order to pptain 
economic maintenance and replacement. 

7* A set of operations must take place within a given time 
interval. Thus it is desired that the range of tiie' 
longest and shortest interval of time not exceed a .1 
certain value, 

STATEMIOT OF THE PROBLEM: 

It is heartening to learn that we can again use the concepts' of 
acceptable quality level (A^L) and rejec table quality level (H'^L) 
together with their respective producer's risk (P.R. or a) and consumer’s 
risk (C.R, or p). That is, the same basic criteria which are i^ 
in making decisions of attributes acceptance are still the important 
ingredients in determining the variables acceptance when the lot .quality 
is measured by the variation. This measure of variation may be Either 
the standard deyiatipn or the ran^^^ 
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To be specific, consider that the acceptable quality level for 


variability ivS given by a’ 


AQL 


S measured in whatever units are 


appropriate. The producer* s risk is some small quantity, say a « ,01 
or 1 %^ That is, if lots of quality better are submitted, we 


will reject them on the average, at most, 1 time in 100. 
hand, consider a lot is rejectable if the variability is 


On the other 


Rgi 


10 . 


The consumer’s risk is, say p 


submitted lots is a* 


RQL 


10 


“ .05 or $%* That is, if the quality of 
or worse, we wish to accept these, lots. 


at most, on the average of 1 time in 20. In addition, let us assume 
that the quality measure can be adequately represented for practical 
purposes by the normal frequency distribution* 


Our objective, then, is to generate a decision making nd.e which 
gives the above desired protection. We shall find two numbers n and 
a^, where n is the sarrple size and is the acceptance standard 

deviation. That is, is the maximum value that the sample standard 

deviation a can have and result in a decision to accept the lot. 
Briefly, our decision rule can be stateds 


1. Take n observations. 


2, If a , accept the lot, and if a> a , reject 
a a 

the lot 

where a 

n 


and x^, i = 1,2,,,., n are the individual 

observations j and 2 is understood as the summation 
over all observations. 


FIl^ST METHOD OF SOLUTION: Single Sapling Plan Based on Sample 


Standard Deviation a. 

How we are read^/ to find both n and Consider the following 

’*cook book" directions: 


Choose a*.,^T 5 


(In the above 

example, 


a “ , 01 , 

o 

, 

H 

CD. 

Form the ratio 


(-f ■ 

4. 

Use Table A for 

d * 01 , 




3, Proceed down column (6) until you bracket the value i* 
by two numbers, namely, 14,02 and 3«85* 
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It. 


5. 


and solve for a . That is 
a 

« 2 

33.1a 

“25 

V 33.1tl X 2g - 6.81 
18 

To suinmari25e our decision ^ 

1* Take n « 18 observations* 

2s Calculate the sauple standard deviation, a. 

3# If a <.6*81 accept the lot, and 
if a> 6*81 reject the lot* 

Companion to every sanpling plan should be ap p^ character- 

istic curve, usually called OC curve* We wish to determine the 
quantity P(a.^ a |a’) « P (the probability of accepting a lot, given 

that aV is. the toe. Now P{a^ I 

P(a^< cy^^lcr*) «* plno^ ^ ^^a I cr* | ^ But for a given a* the 

2 2 

quantity no has a % distributed with n-1 degrees of freedom* 

a’ 2 

Therefore, our basic problem is merely to substitute various values of 
(7* in the expression 

a«\ - P or 

,2 I » 

a' 


2 

The quantity P is determined from the x distribution. A very 


- i 


X a 


From column, (1) , select the sample size n » 18, Iwhich 
corresponds to 1lie smaller ,pf ,the^ brack^^^ valqje.s* 


From column (2) obtain the corresponding 
Form the equation 

2 


33*hls 


« X 


^AQL 
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useful yi table for this puipose is available as Table C in **Engineer- 
ing Statistics and Quality Control** by Irving Burr published by the 
McGraw-Hill Book Co,, Inc*, 1953* 

TABLE I: Values for OC Curve 

Single Sanpling Plan for Variability 

“ AQL EQL ” *0^ 

Plan: iB, a ^ 6.81 accept, o> 6*8l reject, 


a* 

2 

^^a 

a«^ 

P 

a 

0 

00 

100 

h 

52.20 

100 

5 

33. U 

99 

6 

23.20 

86 

7 

17.0li 

55 

8 

13.05 

27 

9 

10.31 

11 

10 

8.35 

1* 

11 

6.90 j 

1.5 

12 

5.80 j 

0.6 


SECOND METHOD OF SOLUTION: Single Sampling Plan Based on Sample Sum 

of Squares SS, 

2 2 

It should be clear that the sum of squares, SS 2x^ - 

is satisfactory as a statistic to determine acceptance for variability* 
Actually, to completely calculate the san^le standard deviation does not 
add information* In fact, the only addition is unnecessary work which we 
may choose to omit* Steps (l), (2), and (3) of the **cook book** direct- 
ions are the same as before. Step (ij) is a bit different and easier * 

It is 

1^. Obtain irom column (2); form the equation 


AQL 

33.iil X 25 335*25 


Now our decision rule becomes: 

1* Take n* 18 observations. 

2* Calculate the sample sum of squares 

SS - (2x.)^ 

1 1 

n 

where x. , ial,2,,.., n are the individual obser- 

vations*^ 
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2 

3. If SS n<T^ « accept the lot, and 

if SS > 83^.25, reject the lot. 

The OC curve for the plan based on the saj«ple sum of squ^es SS 
is identical t^^^^ OC curve based on the saj^le 

standard deviation cr. 


It is possible to choose the values of 

, . '2 

such that the ratio f ' 




AQL" ^ RQL' * ; 

( ^RQi/^*AQl 1 not include^ in 

That is, the sample size n required to give the specified protection 
is greater than the sample sizes listed. For an illustration oi this 
situation see ‘’Techniques of Statistical An^ysis*’ by Eisenhart, Hastay 
and Wallis, McGraw-Hill BookL Co*;,, Inc., 1^6, pp. 231-232. 


THIRD METHOD OF SOLUTIONS Single Sampling Plan Based on the Sample 

■■ Range R. ^ 

At times it is much more convenient and practical to use tj^e sample 
range R as the measure of sample vaoidability. For small saii^Ies, say 
n « 2 to n « 12, the efficiency of the range is quite impressive. 

Again it is our objective to select the quality levels of yari- 
ability which define the plan. That is, suppose we choose ^ 

^*RQL “ ^ ^ } 

Now we must deter^ne twp^^n the sai»?>le size n an^'the^ 

acceptance range R • that is, R is the maa^um value that jihe 

sample range H can have and result to accept 

The decision rule becomes 

1. Take n obseryatipns . 

2. Determine the sample range R. 

3. If R ^ R , accept the lot, and if R > R , 

. a , a . 

reject the lot. 

These are the ”copk bqpk*l s^^ 


1 . 



De te rmine a* 

(In our example 

p " .05.) 

Form the ratio, 


‘^'aQL " ‘^*RQL 



/tI /ryt 

^ m/ AQL 


(15/5) 


a * .01, and 

■ 3. 


3. Use Table B for a « ,01. Proceed down column ^^6) until 
you bracket the value 3 by two numbers, namely, '3,11 and 
2 . 92 . 


h. From column (l), select the sarple size n « 9 -which 
corresponds to the smaller of the braclcetihg values. 
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5. From column (2) obtain the corresponding W 5*08 to 
determine R * 5*08 x 5 ■ 25,1;0. 

To summarize the rule J 

1. If CT« ' 5, a* 15, a * .01, p - .05 

2. Take 9 observations. 

3* Calculate the sample range 

max " ^min 

ii. If R $ 25.1iO, accept the lot, and 
if R > 25.1iO, reject the lot. 

To determine the OC function one has to consider P(R^ R^jaO " 

the probability of accepting a lot given that a* is the true standard 
deviation. This time we look to the probabilities associated with the 
distribution of the range. 

n R 

Now P(a ^ R^|cr') - P(|, < ^ |a') - 

R 

But for a given or*, the distribution — r is given as a probability 

R 

integral of the range W — ^ in samples of size n. Therefore, we 
need to use only 

w ^ ® Or» P. . 


We substitute several values of a* to determine the protection. 

TABLE II: Values for the 00 Cuinre 

Single Sampling Plan for Variability 

AQL “ *^*1101 ^ 

Plans n » 95 K ^ 25«li0 accept, R > 2S>li0 reject. 


a* 

R 

a 

P 

a 

0 

00 

100 

3 

8.1*7 

100 

is 

6.35 

100 

5 

5.08 

99 

6 

lt.23 

93 

7 1 

3.63 

80 

8 . 

3.18 

63 

9 

2.82 

1*5 

i 10 

2.51* 

32 

1 12 

2.12 

11* 

i 15 

1.69 

1* 

i 20 

1.27 

0.7 


452 




FOUICTH MTHpD OF SOTO Onit Sequential Analysis for VariablpLity.^^^ 

Unit sequential sampling exists when observations 
sequenoe. At each stage of sampling, one has the opportunity to, make 
one of three decisions, namely, (l) Accept the lot, (2) Reject ihe 
lot, (3) Continue sampling by taking another observation, 

It is ‘•well known” that a sequential sarpling procedure is 'uniquely 
detemined if we ^ the four quantities which we used to determine 
the single sampling plan. That is, wsi 

interesting nuance with respect to t«iit sequential sampling is |hat the 
n is a random yariable. One does not choose a fixed value of ,yn 
before sampling. There are three considerations which represent the 
characteristics of the sequential plan. These are 

1. PLAN - The decision making rule. 

2, PROTECTION - The OC function. ;; 

3* COST - The ASN function, 

THE PLAN: 

There are just three nimibers that 

quantities ^*RQL* Label these numbers h^^, h^, 

and s, where 

- 2 loge 

0 ti. 

*^2 - 


s - logg "’»g'/g*AQL 


where D » 


Our interest is to present a chart representing the unit sifequential 
acceptance PLAN for variability. The only task that we have is|i tp plot 
two straight lines parallel to each other as in Figure 1* The JjBquations 
of the lines are 

L^ « > + sn 

^2 " ^2 ^ 


where 

slope 

taken 


where 


- h^, hg, and 

of the lines, n 
sequentially, and 

L * 


s are respectively the two intercepts the 
is one less than the number pf pbserva^ons 

2 . ‘ ' 

' 2(x^ - x) 

U+T 


each of the above summations is oyer the n+1 qbse^^ of 


453 



FIGURE is 
L 



The sequential procedure is as followss 

1. Draw the two parallel lines as defined by 

2. Label the vertical axis L . 

Label the horizontal axis n* 

3. Start taking observations (two the first time) and there- 
after adding one observation at a time, 

ii. After each observation calculate the value of L and 

plot it against the value of n, (Notes When the mean 
is unknown, the acceptance and rejection of the lot are 
based on n which is one less than the total number of 
observations ,) 

5, At any stage, if the point falls above the upper line, 
reject the lot; or below the lower line, accept the lot. 

6. As long as -Uie point' falls within the two parallel lines, 
take another observation, 

7# Continue steps hf $3 and 6 until a decision of 
acceptance or rejection is reached. 

The PROTECTION: 

Ordinarily, it is not necessary to determine the OC curve by 
more than five convenient points as follows: 

TABLE III: Values of the OC curve 

Unit Sequential Sanpling Plan for Variability 
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a* 

0 

®’aqi, 

s 


00 

P 

100 

1-a 

*^2 

P 

0 

a 


■ 

j 





However, if one wishes to plot more points on the 00 curve, fbllowing 
is the set of parametric equations in t \rfiich describe P for given 
values of a* 8 ^ 





-2ts 


tCh^+hg) 





th, 

e 

vl 


See references (3) and (6), 

The COST* 

The average sample number (ASN) gives the relation between the 
given standard deviation cr* and the expected number of ob^ 
necessary to make a decision. The ordinate of the ASN curve -Ifor any 
given a* is eaqpressed as 


(ASN)^, 


p 


a 


^ yhg) - hg ^ 

s - ^ 


1 


The above formula ca^ be evaluated without embarrassment ex( 
o* « v'sT Under this situation it can be shown that 


for 


(ASN) 


Vs" 


■- 


This velue will ordinarily be close to the maximum average amount of ,^ 
inspection required to reach a decision. However, again the five 
points, as follows, usually give sufficient information to sketch the 
ASN cui*ve, ■■ / 
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TABLE IV: 


Values of the ASK Curve 

Unit Sequential Sampling Plan for Variability 






0* 


a* 


AQL 


Vi" 


ASN 

* 1 


(l-a)h^ - ahg 


s-a* 


AQL 


+ 1 


+ 1 


a« 


RQL 


00 


h- - (l-p)h, 

± + 1 


statement of Another Problem: 


Consider the problem in which a set of n similar units are re- 
quired for a particular assembly. There is the specification that these 
units do not vary too greatly about any mean value that they might have. 
The specification might read that the range R of the set of n observa- 
tions does not exceed a given constant c. That is, R ^ c for a set 
of n observations. 


We know that a process will not make every set of n units such 
that the range for each set is always less than or equal to a given 
constant. However, we can state that an acceptable process is one 
that produces, say, 98:? of the sets, such that their range is less 
than or equal to ’ 0.5 of a unit of measure. For definiteness let us 
suppose n * 20 units per set. We wish a producer's risk of a ■ 
0.05. A process that yields only 85? of the sets, such that their 
ranges are less than or equal to 0.5 of a unit of measure, is 
considered unacceptable. We wish a consumer's risk of p » .10. 


If we ass\ime that the normal distribution is adequate to represent 
our distribution of measures, we can find the corresponding values of 
^ AQL ^*RQL with the above acceptable and unacceptable 

quality levels. We know that the sample size in this situation is n 
20. Therefore, we can inquire of the tables for the distribution of 
W » R , as to that value of W which satisfies the statement 


P(H S Wa'Ia') 


.02 


( 5 ) 
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We find that this yalne of W is Now substituting R » '*$ and 

W «• 5«U0 in the equation o* » R « •§ “ •dS>6* Similai^y, 

w j:ho 

^*RQL * ^lues 

^'aqL “ ^*RQL * ^ “ *^9 P “ 

■■ s-. -.ij.: -■::. . ■' 

It is clear that we can im^ use Table A to deteriidne eitjhier of 
the two values j a or na ^ to be used in a single sampling plan 

■ gj, 

for variation* In our case^ the decision rule becomes Jj 

. . -k- ■ 

1. Take one set of 20 units and measure each item, -j ; 

' ' " ' . 

2* Calculate the sample sum of squares, SS. 

. . 2 

3. If SS $ na^ , accept the process making sets of 20 
units, and if SS > no , reject the p 2 :ocess* 


The OC curve cap likewiee, be phtaine^^^ previously explained 
when discussing single sampling by using the sample standard dela- 
tion, a. It is interesting to note that' particular prdbiem 
there is a switchs namely, we are using the standard deviation As a 
criterion for decision about tb§ r^ 
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TABLE A: 
Givens 


Single Sampling for Variability Using the Sample a or SS. 


Sam- 

ple 

Size 

x' 

a 

4-, 


n 

a-. 01 

p-.oi 

a«**01 

p».oi 

(1) 

(2) 

(3) 

(it) 

3 

9.21 

.02 

it58.21 


11.3lt 

.12 

98.65 

5 

33.28 

.30 

itit .70 

6 

15.09 

.55 

27.23 

7 

16.81 

.87 

19.28 

8 

I8.it8 

1.2lt 

lit.91 

9 

20.09 

1.65 

12.21 

10 

21.67 

2.09 

10.38 

11 

23. a 

2.56 

9.07 

12 

2l|.72 

3.05 

8.10 

13 

26.22 

3.57 

7.3it 

lit 

27.69 

It.ll 

6.7it 


29 .II 1 

it. 66 

6.25 

16 

30.58 

5.23 

5.85 

17 

32.00 

5.81 

5.51 

18 

33. ia 

6.1jl 

5.21 

19 

3lt.80 

7.02 

it .96 

20 

36.19 

7.63 

it.7it 

21 

37.57 

8.26 

it.55 

22 

38.93 

8.90 

it.38 

23 

itO .29 

9.5it 

it. 22 

2it 

la.61t 

10.20 

it.08 

25 

lt2.98 

10.86 

3.96 

26 

ltlt.31 

11.52 

3.85 

27 

lt5.6U 

12.20 

3.7it 

28 

it6.96 

12.88 

3.65 

29 

it8.28 

13.56 

3.56 

30 

lt9.59 

lit. 26 

3.it8 

31 

50.89 

llt.95 

3.ii0 




• 

a 

CD. 

aa.Ol 

P-.05 

p=.io 

a=.01 

p-.lO 

(?) 

(6) 

(7) 

(8) 

.10 

89.it2 

.21 

it3.65 

.35 

32.23 

.58 

19.it3 

.71 

18.67 

1.06 

12.1t8 

l.lit 

13.18 

1.6L 

9.37 

1.6it 

10.28 

2.20 

7.63 

2.17 

8.53 

2.83 

6.52 

2.73 

7.35 

3.it9 

5.76 

3.32 

6.52 

it. 17 

5.20 

3.9it 

5.89 

it. 86 

it.77 

it.58 

5.it0 

5.58 

it.it3 

5.23 

5.02 

6.30 

it.l6 

5.89 

it. 70 

7.0it 

3.93 

6.57 

it.it3 

7.79 

3.7it 

7.26 

it. a 

8.55 

3.58 

7.96 

it.02 

9.31 

3.iiit 

8.67 

3.85 

10.08 

3.31 

9.39 

3.71 

10.86 

3.20 

10.12 

3.58 

11.65 

3.11 

10.85 

3.it6 

12.1tlt 

3.02 

11.59 

3.36 

13.2lt 

2.9it 

12.3tt 

3.27 

lit.Oli 

2.87 

13.09 

3.18 

lit.85 

2.80 

13.85 

3.10 

15.66 

2.7it 

lit.6l 

3.03 

I6.it7 

2.69 

15.38 

2.97 

17.29 

2.61t 

16.15 

2.91 

18.11 

2.59 

16.93 

2.85 

I8.9it 

2.55 

17.71 

2.80 

19.77 

2.51 

I8.ii9 

2.75 

20.60 

2.it7 
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Aj Single San^ling for VariaWLlltgr (Contiriiaed) 

Given: P 


Sain- 

p3,e 

Size 

'•a 

ecu 

< 




11 

a«>,05 

p».oi 

a-,o5 

p-.Ol 

P".05 

o».o5 

P-.05 


a*. 05 
p-.io 

(1) 

(2) 

(3) 

(8) 

(5) 

(6) 

(7) i 

(8) 

3 

5.99 

.02 

298.06 

.10 

58.16 

.21 •' 

28.39 

1* 

7.82 

.12 

67.96 

.35 

22.20 

.58 

13.36 


9.1:9 

.30 

31.95 

.71 

13.38 

i.o6 ; 

8.92 

6 

11.07 

.55 

19.98 

1.18 

9.67 


6.88 

7 

12.59 

.87 

18.88 

1.68 

7.70 

2.20 ' 

5.71 

8 

18.07 

1.28 

11.35 

2.17 

6.89 

2.83 

■ ■ 'ri • ■ 

8.97 

9 

15.51 

1.65 

9.82 

2.73 

5.67 

3.89 “ 

8.88 

10 

16.92 

2.09 

8.10 

3.32 

5.09 

8.i7 " 

8.06 

11 

18.31 

2.56 

7.16 

3.98 

8.65 

8.86 J 

3.76 

12 

19.68 

3.05 

6.88 

8.58 

8.30 


3.53 

13 

21.03 

3.57 

5.89 

5.22 

8.02 

6.30 

'3.'38 

3.18 

11: 

22.36 

8.11 

5.88 

5.89 

3.80 

7.o8 

15 

23.68 

8.66 

5.08 

6.57 

3.60 

7 . 79 " 

3.08 

16 

28.99 

5.23 

8.78 

7.26 

3.88 

8.55 

2.92 

17 

26.30 

5.81 

8.52 

7.96 

3.30 

9.31 :: 

2,82 

18 

27.59 

6.81 

8.31 

8.67 

3.18 

10.08; 

2,78 

19 

28.87 

7.02 

8.12 

9.39 

3.07 

10.86' 

2.66 

20 

30.3it 

7.63 

3.95 

10.12 

2.98 

11.65 ; 

2.59 

21 

31.81 

8.26 

3.80 

10.85 

2.89 

12.88 

2.52 

22 

32.67 

8.90 

3.67 

11.59 

2.82 

13.28 

2.87 

23 

33.92 

9.58 

3.56 

12.38 

2.75 

18.08: 

2.82 

21: 

35.17 

10.20 

3.85 

13.09 

2.69 

18.85 

2.37 

25 

36.82 

10.86 

3.35 

13.85 

2.63 

15.66; 

:2,33. 

26 

37.65 

11.52 

3.27 

18.61 

2.58 

16.87 

2.29 

27 

38.88 

12.20 

3.19 

15.38 

2.53 

17.29"' 

2.25 

28 

80.11 

12.88 

3.11 

16.15 

2.88 

18.11 

2.21 

29 

81.38 

13.56 

3.05 

16.93 

2.88 

18.98; 

2.18 

30 

82.56 

18.28 

2.99 

17.71 

2.80 

19.7f ' 

2;'i8 

31 

83.77 

18.95 

2.93 

18.89 

2.37 

20.60 

2.33 
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MHIB'Aj Single Sampling for Variability 


(Continued) 

Sam- 

o 







ple 

Size 

’‘a 

*l-p 

2 2 



n 

a».lo 

p=.oi 

a-. 10 
p-.oi 

P-.05 

a=.10 

p=.o5 

p-.io 

a=.10 

p-.io 


(2) 

0) 

(1*) 

(5) 

(6) 

(7) 

(8) 

3 

it>60 

.02 

229.10 

.10 

1*1*. 71 

.21 

21.82 

It 

6.25 

.12 

51*.36 

.35 

17.76 

.58 

10.70 

5 

7.78 

.30 

26.19 

.71 

10.95 

1.06 

7.31 

6 

9.21* 

.55 

16.67 

l.ll* 

8.07 

1.61 

5.71* 

7 

o 

10.61| 

.87 

12.21 

1.61* 

6.51 

2.20 

1*.83 

0 

12.02 

1.2li 

9.70 

2.17 

5.55 

2.83 

lt.2l* 

9 

13.36 

1.65 

8.12 

2.73 

1*.89 

3.1*9 

3.83 

10 

ll*.68 

2.09 

7.03 

3.32 

1*.1*2 

1*.17 

3.52 

11 

15.99 

2.56 

6.25 

3.91* 

1*.06 

1*.86 

3.29 

12 

17.28 

3.05 

5.66 

1*.58 

3.78 

5.58 

3.10 

13 

-I t 

18.55 

3.57 

5.19 

5.23 

3.55 

6.30 

2.9I* 

14 

19.81 

l*.ll 

1,.82 

5.89 

3.36 

7.01* 

2.81 

15 

21.06 

1*.66 

1*.52 

6.57 

3.21 

7.79 

2.70 

16 

22.30 

5.23 

1*.27 

7.26 

3.07 

8.55 

2.61 

17 

23.51* 

5.81 

1*.06 

7.96 

2.96 

9.31 

2.53 

18 

2l*.77 

6.1,1 

3.87 

8.67 

2.86 

10.08 

2.1*6 

19 

25.99 

7.02 

3.70 

9.39 

2.77 

10.86 

2.39 

20 

27.20 

7.63 

3.56 

10.12 

2.69 

11.65 

2.33 

21 

28.1il 

8.26 

3.1*1* 

10.85 

2.62 

12.1*1* 

2.28 

22 

29.62 

8.90 

3.33 

11.59 

2.56 

13.21* 

2.21* 

23 

30.81 

9.51* 

3.23 

12.31* 

2.50 

ll*.0l* 

2.19 

2 h 

32.01 

10.20 

3.11* 

13.09 

2.1,1* 

11*. 85 

2.16 

25 

33.20 

10.86 

3.06 

13.85 

2.1*0 

15.66 

2.12 

26 

3l*.38 

11.52 

2.98 

ll*.6l 

2.35 

16.1*7 

2.09 

27 

35.56 

12.20 

2.92 

15.38 

2.31 

17.29 

2.06 

28 

36.7I1 

12.88 

2.85 

16.15 

2.27 

18.11 

2.03 

29 

37.92 

13.56 

2.80 

16.93 

2.21* 

18.91* 

2.00 

30 

31 

39.09 

i*0.2(5,. 

11*. 26 
11*. 95 

2.71* 

2.69 

17.71 

18.1*9 

2,21 

2.18 

19.77 

20.60 

1.98 

1.95 
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TABLE B: Single Sampling for Variability Using the Sajnple Rarige R, 
Given: a' 


Sam- 


pie 

Size 

1-a 

n 

a«,01 

(1) 

(2) 

2 

3.61* 

3 

i*.10 

h 

it.38 

5 

h.$9 

6 

h.lk 

7 

1*.87 

8 

It. 98 

9 

5.06 

10 

5.15 

11 

5.22 

12 

5.28 


a, p 




p-.d 

a-.Ol 

p-.oi 

(3) 

(it) 

.02 

182.00 

.22 

18.61* 

.1*7 

9.32 

.70 

6.56 

.89 

5.32 

1.07 

1*.55 

1.22 

1*.08 

1.36 

3.73 

1.1*8 

3.1*8 

1.59 

3.28 

1.69 

3.12 




P-.05 

a»,Ol 

p=.(^ 

(5) 

(6): 

.09 

1*0. l|l* 

.1*5 

9.11 

.77 

5.69 



l.Ol* 

i*.li. 

1.26 

3.76 

1.1*1* 

3.18 

i.6o 

3.11 

1.71* 

2.92 

1.86 

2-I7 

1.97 

2.65 

2.07 

2.^5 


Sam- 






ple 

Size 

1 

P 

"P 


p 


n 

a«,05 

p-.oi 

o».o5 

p-.oi 

P-.05 

o“.65 

P-.05 

(1) 

(2) 

(3) 

(1*) 

(5) 


2 

2.77 

.02 

138.50 

.09 

30.78 

'3 

3.31* 

.22 

15.18 

.1*5 

7.1*2 

1* 

3.65 

.1*7 

7.77 

.77 

1*.71* 

5 

3.87 

.70 

5.53 

1.01* 

3.72 

6 

it.ol* 

.89 

1.51* 

1.26 

3.^1 

7 

1*.18 

1.07 

3.91 

1.1*1* 

2.90 

8 

1*.29 

1.22 

3.52 

1.60 

2.68 

9 

1*.39 

1.36 

3.23 

1.71* 

2.52 

10 

1*.1*8 

1.1*8 

3.03 

1.86 

2.1*1 

11 

1*.55 

1.59 

2.86 

1.97 

2^31 

12 

1*.62 

1.69 

2.73 

2.07 

2^23 
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SAl'iFtlHG IHSHECTION BI VARIAHffiS Vlt 

AVAILABLE SAMPLING PUBS | 

!!■■■■■ . 

R* Storer :? 

Phillips Petroleum Coinpany !: 

Suppose that one has the. y tec|nique and 

is persuaded that it offers some possibility of use in a partict^ar 
spection problem# What comes next? Is it necessary to create a plan to 
suit the /problem? What other factors must be considered prior |q in- 
stalling a plan for a trial run? ; ^ . ; 

Building a plan from scratch will probably be unnecessary*' ^'our 
good sets of plans are readily available from which to choose* j|At least 
one of the two or three himclred plans in these sets should meet^the need 
with little, if any, modification. 

As for “other factors”, it is suggested only that the prospective 
user talce a last, close look at the question whether a variables in- 
spection plan is appropriate to his needs* In particular, he should con- 
sider the matters of cost, purpose of the inspection, distribution of the 
quality characteristic which interests him, and ease of administration. 

” ' "" . - - n 

Some of the earliest of variables inspection for percent 

defective in this eg was occasioned by situations in which: cost was 
a secondary consideration. The problem was to. make the most of| a s^ple 
which, by any standards, was too small. The product was expensive and 
complicated, the total nmber maniifactured small, the inspectioin totally 
destructive. Variables, inspection was a means of extracting maximum 
information from an inspection which would be extremely costly 'Regardless 
of how the data were used, ' 

Most industrial applications are, unfortunately, less cle|n-cut. 

Given a certaip n^ on which d.ecis ions must bejmade, the 

costs involved can be represented as follows; ^ 

F - fH, the total number of pieces to be inspected if the .fraction 
inspected is f , 

C = Fc, the total cost of inspecting the material, neglecting re- 
jections, when the cost of inspecting one unit is’'C, 

E, the cost of inspection equipment required, 

D - Ld, the cost of reaching decisions on the .inspection lata when 
the number of decisions (lots) is L and the cost per lot is 

d. 

R » Fr, the total cost of product destroyed or damaged by* inspection 
when r is the unit cost of product, including;' cost of 
repair where applicable, 

,, ; . ! . ■ . ■ 'ii. ■■■ 

W® C+E+D+Ris the total cost of reaching the decisions . 

The cost elements, obviously, are rather mqre complicated';' than a 
simple determination as to which m^ the more inspection. For 

simple inspections on small samples, the Indioations are that ;-the attri- 
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butes approach enjoys same cost advantage* As the sample size increases 
the inspection cost differential tends to decrease, though still favoring 
the attribute approach to some extent, but the decision (computation) 
costs increase* In more complicated dimensional inspections, the situ- 
ation may well be reversed* Inspection setups for such characteristics 
as the alignment of several points, or the relative position of several 
surfaces, may be more expensive both to instrimient and to operate on an 
attributes basis than on a variables basis* In any case, inspectors tend 
to regard the variables approach as **more trouble”. It is well to maJce a 
fairly complete cost analysis in order to be in position to give a defini- 
tive answer to this charge, if for no other reason. When the required 
figures are unavailable, catalogs, a table of standard times, a stopwatch 
and a few hours should yield estimates good enough for comparative 
purposes. 

Purpose is often the determining factor in the decision between the 
attributes and variables approaches. It is one thing to select a plan 
for deciding whether to buy or not to buy a lot of product* Quite another 
thing to select a plan appropriate to a decision whether a lot of material 
is suitable for a certain contemplated use, and something else again if the 
purpose is control of production. Sometimes decisions are required for a 
project which is a mixture of these pijrposes. New products, for example, 
usually demand more attention and. information than products which have 
been satisfactorily produced over a period of months or years. A vari- 
ables plan might well be indicated for such an application, regardless of 
any real or supposed advantages of the attributes approach. Many other 
engineering situations exist where the extra costs of measurement and 
computation, even when added to a sample large enough for an attributes 
decision, seem worthwhile. Discussion with the product designers or 
users should be helpful in resolving this point. 

Note that the sampling plans under discussion here are primarily 
aimed at the situation where interest lies in fraction defective, or 
joint variation of mean and dispersion. The same data may be used where 
interest centers primarily on the mean or the disjoint variation of mean 
and dispersion, or for control charting. But the decision procediure 
X i ks ^ U, L is not appropriate to such applications. 

Sometimes the nature of the inspection or test determines whether 
attributes or variables will be used. Tensile strength determinations, 
for example, are seldom reported on an attribute basis because of the way 
in which they are derived. Since the reading must be obtained from a 
graduated dial in any case, it is sensible to use it as reported rather 
than convert it to “good” or “bad”. If you are not familiar id.th the 
inspection operation, or know it only by reports ftom others, personal 
observation would be a good idea prior to disposing this factor, 

A factor which can cause unnecessary trouble is the form of distri- 
bution of the characteristic inspected. One hears that detailed evidence 
of normality is necessary to the successful use of variables Inspection - 
- and on the other hand that the type of distribution makes no difference. 
If the first be true, then so much must be known about the product in ad- 
vance of inspection that the necessity for inspection is questionable. If 
the latter be true, then many excellent men have spent much time trying to 
solve a non-existent problem. 

As usual, the truth is somewhere between the two extremes. If a 
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fairly substantial proportion of product exceeding the liinits IJ 
has been removed from the material by screening prior to sampling, 
someone is going to be most unhappy with the rejection decision which 
is almost siij’e Tto follow in tKe wSce of applicat'i^^ ‘^unmodi- 

fied variables plan* The effect is the same as if the plans possessed 
a sixth sense that non-conforming product was once in the Tot, and' lac]feed 
the horse sense to recognize that it had been removed* An attrilputes 
plan, or a combined variables -attributes scheme of Some sort is Indi- 
cated for such a situation* :: 

Slight departures from the normal curve model will cause trouble 
only if both persistent (rather than intermittent) and unrecognized* If 
it is found that a distribution is ‘’skewed^* rather than symmetrical, the 
multiplier ”3^’ which is customarily used on sigma to obtain end-points 
of the distribution must be changed to “2" or or *'5** or some*; other 
number. KnOwing this, we can either tise plans based upon the mu|.tipller 
*'3*' and adopt a different or mor^^^^ liberal' interpretation of an indication 
that a limit has been exceeded f or, we may concoct a hew plan based upon 
a multiplier appropriate to the distribution model which describes our 
problem more exactly. A Control Chart test on some preliminary data, or 
any of several ••quick and dirty^* tests for normality should, give'; the 
desired information rather quickly* f! ' 

One last point to be considered in the ••whether variables •• decision: 
Ease of administration. It is easier to teach an inspectbr to"u|e' a shap 
gage correctly than to teach him to use a dial gage correctly, fie is 
more likely to be consistently accurate with the snap gage than |he dial* 
Attribute reporting forms are generally simpler and less subject to arith- 
metical error than variables reporting forms. At least, this has been my 
experience, and I find that many inspection administrators agree* These 
factors must be carefully weighed where a substantial number of Inspectors 
is involved or the inspection locations are so widely dispersed ihat 
supervision is difficult. 

Ass'umlng that this •'last look" at suitability does not change the 
original assessment that a variables plan will fill the bill, a seining 
of the available sets of plans is in order. 

The exiles t widely available set of tables was published by Bowker 
and Goode (l/in 1952* .. .Their book contains, in addition to the tables, a 
thorough and easily read exploration of the development and use pf vari- 
ables inspection plans for the fraction defective. 

Their tables utilize only the sample standard deviation as a measure 
of variability, but are otherwise the set available at 

time of writing. Fifteen AQL classes and fourteen AOQL classes tabu- 
lated. Separate sets of plans are given for the situation where the 
standard, deviation is tinknown, and for the situation where some ^evious 
history is available for its estimation, k values in the formerjset are 
somewhat smaller than in the latter, leading to more conservative de- 
cisions. i; 

The tabulated plans are for use against one-sided specif ica|ions: 

Use of two one-sided plans is recoinraended for the situation wher| e , 
history is available from which to estimate the standard deviation and 
the difference U-L is at least M times the standard, deviation.^ii is a 
tabulated factor which varies with the AQL. ^/^en U- L <1 M a 
graphical decision procedure is provided, the acceptance region for the 
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graph, being constructed, with the assistance of a table of factors classi- 
fied by sample size and AQL. 

Operating characteristic curves are provided for plans operating 
against one-sided limits. Normal, reduced and tightened inspection are 
available as well as single and double sampling, 

A table of control chart factors is provided for use with standard 
deviations computed on n-1 rather than n. 

The plans have been constructed in accordance with the concept that 
the AQL is that percent defective for which the probability of acceptance 
is about 95^, regardless of lot size. Operating characteristics were 
determined with a view to companionate use of the attribute plans con- 
structed for the Navy by the Columbia Research Group, This , pair of 
books is an excellent base for a systematic inspection scheme of general 
coverage. Since both AQL and AOQL classifications are available, a set 
of Continuous Sampling Inspection Plans can be easily tied in, providing 
plans for accept/reject decisions in. a wide variety of production and 
inspection situations. 

Navy Bureau of Ordnance tables for inspection by variables were 
issued in 195^ as a government document rather than through commercial 
channels. Comparison to the Bowker and Goode Tables reveals several 
differences and some similarities. 

All the Navy plans utilize standard deviation as a measure of vari- 
ability, Six AQL classes are provided. No classification by AOQL is 
offered. Normal, tightened and reduced inspection are available, but 
double-sampling plans have been omitted. 

Each plan is designed to have operating characteristics similar to 
the MIL-STD-105A plan (attributes) of equivalent AQL and lot size. The 
probability of accepting material which is AQL percent defective therefore 
increases as the lot size increases, rather than remaining at 95 % for all 
lot sizes. Every effort has been made to make OC curves match those in 
.MIL-STD-105A as closely as possible. 

The outstanding feature of these plans, as compared to others pre- 
sently available, is the form in which the inspection data is processed 
to reach a decision, Bowker and Goode, and the Army Ordnance tables are 
both based upon finding an average, 3c , to which is added (or subtracted) 
a factor obtained by multiplying the observed standard deviation, s, by 
a factor k. The result, for example x + ks, is then directly compared te 
a given limit for the characteristic, say, U, 

The Navy tables handle this procedure on the basis of a “Lot Quality 
Index”, the derivation of which is as follows. Suppose x 4- ks - II, Then 
k - U - 3c , If we add 10 to both sides of this equation, and give the 
s 

quantity k + 10 the designation C-y, we obtain the Lot Quality Index 
% ~ II - X 4 10 , In practice, Cu (or 0^) is computed from the in- 
s 

spection data and compared to the tabulated value of the index, called 
Atj (or At ) for the particular AQL and sample size being used, the de- 
cision being based upon whether the tabular value is, or is not, exceeded. 

Another innovation is the Maximiua Allowable Standard Deviation 
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(M^^D) concept for the case where inspection against a two-sided^' limit ie 
required. MASD is defined and computed in the form U^-L • The>esults 

must meet all of the criteria C^j - Aig, Cj, - Aj^, s ^ MA3D. This pro- 
cedtire avoids the nepessity for a special graphical soluiioni as're- 
quired by the Bowker ^ Goode pl£i^^ A vrarthwhile practical adva|ice, 
since most inspectors for some reason share an aversion to this ^ind of 
graphical decision. It has the added advantage of protecting against the 
sitmtion where the standard deviation is top' large for the saf^iise of 
two one-sided plans, but without introducing the idea of '^knowh Itahdard 
deviation” which is confusing to some people. 

The inspection instructions included in . these ,,t^ 
less likely to be suitable for general industrial use than the Bpwker and 
Goode plans because of the more special i25ed use intended for the'iHavy 
document. However, the tables themselves are compact and quite useful in 
many industrial situations. A standard computation form is provided 
which is very efficient for any procedure which requires computajtion of 
the standard deviation. 

■ The Army Ordnance tables were published in 1954* , They use the 
constant-risk principle employed by Bowker and Goode; the probability of 
acceptance for material of AQt quality is regardless of lot: size* 
Eleven AQIj classes are provided; AOQli classification is omitted,’' in 
accordance with recent government practice. 

The features which distinguish these tables from the othef '{two are 
as^ follows. A set of plans is provided which utilizes the ranged as a 
measure of variatipn, in addition to the lasual set utilizing the.|. standard 
deviation. The tables are compact. A single page serves to expWss all 
the information (except 00 curves) required to use either the rs^fige or 
the standard deviation plans. The MASP concept has been simplified to a 
factor, F, which is listed in the body of the tables along with the 
constant, k. 

The two sets of plans (range and standard deviation) have been so 
arranged that the protection afforded by a given sample size and- AQt is 
about the same, regardless of which measure of variation is chpeeii* ^be 
standard deviation plans accept less material of worse -than-A(5P quality 
than do the range plans, but the differehce is so .slight that a "single 
set of Operating Characteristic Curves suffices to describe both! sets of 
plans, for practical purposes. ^ - 

As with the Bowker and Goode plans, decision is mde in tsi^ of 
data as observed, without conversion to intermediate factor s or {fraction 
defective. In the two-sided case, which is the most comnlicated, the 
three criteria required are: x + kV - U, x - kV - L, V - F (U - L). 

(7) i 

In 1955 Lieberman and Resnikpf f published a new set of sampling 
tables developed at Stanford, along with a summary of the considerable 
theoretical work which led to these plans. These tables afford a choice 
among fourteen AQl classes* Unknown standard deviation, known standard 
deviation and avenage f ahge plans are provided. Single sampling at one 
level of inspection is :used throughout but reduced inspection is' in 
effect available by switching from "unknown” to "known" standard devia- 
tion when sufficient data has been cpllected. Operating characfbristic 
curves are available for all plans, including those for use against 
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two-sided limits. 


AQJjS follow the MIL-STD-105A pfractice, the probability of acceptance 
for AQL quality ranging ftom about .89 for the smallest sample size to 
about .99 for the largest sample size. A single OC curve describes un- 
known standard deviation, known standard deviation or average ’ range plans 
for a given AQL against either a one-sided or a two-sided limit. However 
the sample size is given by code letter and will be found to differ with 
the measure of variation chosen. Code letter ”1*’, for example, represents 
a sample size of 5 if a known standard deviation is usedj 25 for unknown 
standard deviation; 30 for an average range plan. 

Decisions are reached by a three stage process. First, the quantity 
C = U - X , or its equivalent for lower limits and other measures of vari- 
s 

ation, is computed. Then C is used to enter a table which gives an esti- 
mate p of the fraction defective of the lot from which the sample was 
drawn, p is then compared to a value p* obtained from the sampling table. 

If p - p^, accept; otherwise, reject. When a two sided specifi- 
cation is involved, the estimates for the fraction beyond upper and lower 
limits are added and. compared to p*, that is, f u 
terion of acceptance. 

As of the time of this writing, a Military Standard for Inspection 
by Variables has been in preparation for something like three years. 
Although it is nearing the stage of publication, it is not yet ready. In 
any case, information concerning its content should properly come from a 
government employee, I hope, however, that when it does appear it will 
be found to combine, the best features of existing sets of plans in such a 
way as to provide a document of widespread usefulness in both industry 
and goyernment. 

If none of the published sets of plans seem to fit your require- 
ments, References 1, 2, and 5 through 11 provide the theory and some 
computational suggestions for constructing additional plans. 

Selection of an appropriate plan from a given set boils down to 
decisions on measure of variation, AQIj and sample size. The relative 
efficiency of the range and standard deviation need not enter into the 
selection since ‘equivalent AQLs provide eq\iivalent operating charac- 
teristics regardless of the statistic chosen. In the Army tables the 
choice of statistic makes no difference in sample size. In the Lieberman 
and Resnikoff tables it makes a considerable difference. From a practi- 
cal standpoint, the range is the preferred measure for routine accept/ 
reject inspections. Standard deviation is usually chosen for inspections 
having an engineering use, 

I would like to include a short, set of rules for choosing an ap- 
propriate AQL, but so far as I know these r\iLes have not yet been de- 
vised. Generally, I would assign the smaller AQLs for characteristics of 
greater importance, larger AQLs for those of lesser importance. If the 
distribution has a tendency toward long tails on one or both sides, the 
AQL may have to be made somewhat larger than usual if the specification 
limits are relatively narrow. Or, it may be necessarj^ to open up the 
limits somewhat. If this is not done, the plan will reject more frequent- 
ly than anticipated from the AQL, assuming that AQL qviality material is 
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made and presented for Inspection*^,. 

In each of the tables mentioned the Lieberman and Resnikoff 

tables, sample size is fixed by determining an inspection level and a lot 
size. Where destructlye tests are concerned, it may be advisable to 
disengage this automatic seleption,. feature, and pick a constant sample size 
which management can or will pay for. This is frequently much smaller 
than the table.s require . The Army tables pr ovide a "category of . in- 
spection" label to fa.cilitate , such ha^^dli^ and to remove any do\ibt 
which might exist on the question whether such a departure is proper. 
Wherever possible, I recommend citing the sample size and acceptance 
constants in the inspection instructions, rather than referring the 
inspector to the tables . This practice minimizes both the, nmbet „o 
documents and tl:^ number of ways in which the inspector can make! a mis- 
take. 

If the circumstances permit, a shakedown trial of the selected plan 
is an excellent idea. Like any good tool, variables inspection iflrorks 
best in the hands of one experienced in its use. 
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QUAim cp^ 

F* J* Sin^elar 

H. J. Wilkinson ^ 

Intern^tio^l Businefgf Machii^s Corporation 

Today's Quality function finds itself farcing a tremendous |]tol~ 
lenge. Regardless of product^ the impacts of new n^Lterials, auto- 
mation capabilities and inci'easin^ product conqplexity on the 
manufacturing effort it is assisting, coupled with the performance 
and reliability requirements beccmiing associated wit^ product end use, 
axe presenting an environment requiring technical and adiid.nistfa|;iye 
planning of the highest caliber ^ In the design of such a quality 
function, serious thought must be given to a system concept of relating 
part, process and assembly data to the product system. This type of 
planning must be in addition to the corrective action feed|» 
mally associated with any data taking. . ^ 

We will attempt to show the evolution of areas afsqpiajted 
with the quality function and explore two examples of the approach to 
system design in quality control. 

The quality function has usually been aligned with these cjLassi- 
cal functions : 

Receiving 

Manufacturing 

Assembly v 

However, while the scope of each of these functions 
expanded during the past several yeetrs, there has been a tendency 
toward the generation of spheres of activity due possibly to the! 
specialized product and process techniques involved* This philosophy 
has obviously tended to isblate l^ese f^ 

failure of feedthrough of information to the area charged with final 
product evaluation. One might indicate the chaises in scope as:| 
follows: 

I. Re ce i ving Inspe c t ion 


Raw Material Control 
Vendor Rating 

. Vendor Oertification.^^. 

Component and Sub-assembiy Receiving 
Life Test 

II. MBugufacturing 

Process Control -- Treat, Plating 

Gage Control 

Tool Inspection 

Machine Tool Capabilities 
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BASIC ORGANIZATION 
OF A QUALITY FUNCTION 



FI6:#I 


III* Assem bly 

Process Control - Electronic Component Manufactxire 
Life Test Data 

Assembly - Product Evalxaation 
Test Equipment Capabilities 
Product Field Performance 

Obviously the grouping of the above areas is dependent on the 
particular company and product involved. The important point at this 
time is the fact that the areas of involvement have increased con- 
siderably. We now realize that we can no longer be satisfied with 
these sources as individual areas of control. They must necesseirily 
be related to each other as part of a system. 

We are at the crossroads in the sense that while Quality Control 
has been able to show the feasibility of the statistical approach as a 
practical mecms of controlling pcurt and process quality we must, in 
addition, devise ways of combining these data from many areas and 
relating them to final product evaluation. This must be accomplished 
in order that the need for costly and often misleading performance 
testing of complex products might be more thoughtfully considered, 
interpreted, and thereby reduced or eliminated. 

The fact that a given device meets a functionEuL or acceptance 
test is not necessarily indicative of its reliability in a customer *s 
installation. This knowledge can only come of a complete history 
consisting of data representing raw material, peu*ts, sub-assemblies, 
final assembly, and the test experience relating to the unit or system 
under study. 

Figure 1 shows the basic Quality Control Organization, the usual 
line supporting functions, and with Quality Engineering as a staff 
function. 
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QUALITY ENGINEIRIMG 
DEPARTMENT 



T^he concept of a quality engineering group designed to act ^las a 
service organization in the quality function is certainly not a dev 
one. However, we vould propose that organized system design is ijlpt 
possible without the services of such a group. 

Figure 2 shows a basic Quality Engineering Depart^ 
individual areas outlined by function. We do not propose to go ipto 
great detail regarding this organization since considerable material 
has already been written on this subject. However/ from a system 
standpoint, we may ask the question, "What can such a groi;^ contribute 
to system design?" We might well review the tools that such a grbup 
would of necessity avail itself of in developing system concepts:!' 

A. Khowledge of proven statistical tools 

B. Ability to initiate and interpret designed experiments :1 

C. Ability to establish test equipment requirements 

B. Experience in and knowledge of manufacturing processes ' 
and techniques 5 

A quality engineering group so trained suad assigned can give 
the quality function the type of system thinking which is requirdji 
in order to completely integrate the incoming materials and the out- 
going final product. With such a group assigned to evaluate product 
quality, management is in a position to probe new areas and new ;; 
concepts by means of which system thinking can be applied to both, 
product quality and those problems of quality administration so ; 
necessary to both the field and factory organizations. 


473 




A QUALITY "system" 
INCOMING MATERIAL 
COMPONENTS .ASSEMBLIES 
a UNITS 



CUSTOMER, 

ENGINEERING 

CUSTOMER 


FIG. #3 
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It should be jaoted that the successful a^licattou of botli' 
Manufacturing and Qu^lty Engineering aiaiaiysis must he 
conipietely adequate l^rbduct Engineering cif ications • ' 

Figure 3 shows some basic inter -relat ions of a quality syiteiin " 
combining vendor/ process^ assembly and field information. While in 
each area we see Bechah^ to provide corrective action data for 
manufactviring within each small system, final product evaluation' 
can be affected to a very marked degree when decisions are basetf on^ 
data gathered proves 8 ively from process iiput to product line output. 

A good case and point is the control of a P^ely mantaal manu- 
facturing process— soldering of electrical connections by hand" 
methods . We have here a relatively small sub-assembly subject to a 
large number of variables, any one of which may seriously affect ’its 
all important electrical characteristics/ 

The following are some of the more obvious variables which' we 
have to contend with in this type of connection; ! 



Surface Preparation :! 

Mechanical Stability 

Solder Alloys 

Fluxes 

Temperature 

Operator Techniques 

The presence of such a critical process in large quantities, as 
is the case in many phases of commuhicatibh coi]^ guidahc| 

systems, can have a tremendous effect on product performance and” 
reliability. This can be of partlculaf impbrtahce in circ\iitry in- 
volving high frequency pulse logic. ^ 

Process evaluation must occur early in product life and mult be 
sustained throughout the assembly euid test stages so the final ap- 
praisal can be accomplished by audit mechanisms rather than by | 
questionable screening or inconclusive functional testing. Figure 4 
presents a system concerned with a manufacturing area receiving three 
basic types of material. This Includes a unit vendor and panel ven- 
dor, each building a product to print requiremehts, and an electyohic 
component vendor supplying an off-the-shelf item. 

In the case of the two vendors supplying electronic equipment, 
acceptance procedures, as noted by the small triangles, constitute 
the first step in the control and analysis of solder quality. Tte ' 
same acceptance procedures in the Receiving Inspection Deparimaent 
constitute the tool wherein auditing is accomplished. In addition, 
an analysis procedure is also used in this area in order to audit 
component surface solderability. Thus we see that the imit and fys tern 
assembly area is presented with material whose quality levels, with 
regard to solder quality, are known and \mder control. 

The vinit and system assembly area has within it an addltip|al 
acceptance procedure designed to control €uad audit any solder ! 
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SOLDER CONNECTION 
QUALITY ANALYSIS 



QUALITY CONTROL SPECIFICATIONS 


FIG. #4 
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connections vhich have been th!e resiJQlt of change or repair 

activity. This type of control system placed the ir»n\afact\n:iiag 
in a position wherein Its fin^ may be audited to determine 

whether or not the levels previously established have been altered. 

It should be noted that while the various areas shown here have ^ithin 
them the necessary acceptance ^ analysis or audit procedures, axnciliary 
specifications or controls are certainly required for the complete 
accomplishment of the system philosophy* These may well include'’ the 
followingr 


In-plant operator training in solder techniques 
Assistance to vendors in o^rator training 
Control of soldering tools 
Solder material certification 

A second approach to the system concept is shown in Figure' 5* 

This example concerns itself with electron tube qiiality and reliability 
analysis. We see here a product controlled by the usual engineering 
specification and in addition a Quality Acceptance Procedure . This 
procedure in ef fect at both the vendors * plants and the receiving in- 
spection area establishes compatible tests and quality levels, in 
this way, the first check point in product q^ established. The 

second check point is established by means of a documented line reject 
program. Data in this area provides a means for reviewing vendor and 
receiving compatibility, and also provides the first step in the ‘cor- 
relation of tube specifications and circuit requirements. The third 
point in the data system is provided fey means of the analysis material 
made available from the field ins tallatiQns, By proper study, data 
from these three areas can contribute considerably to the foliow|ng: 

A, Life characteristics 

B, Test equipment correlation 

C* Tube application 

D. Diagnostic techniques 


In the coinrse of this discussion we have touched on severa| dif- 
ferent kinds of quality procedures. These dpcvuflents, under engineering 
control, are the culmination of tha quality engineer’s evaluation of 
the variables and controls whichTie^^^^^^^f^ witfe a 

given process. The kinds of procedures will certainly vary dependent 
on the activity. The following are a few possibilities j 


Acceptance 

Process Control 

Analysis 

Audit 

Pinal Test 

Reliability 

Maintenance 



A procedural guide assures a favorable and similar format fpr 
procedures in general and also maintains compatibility between several 
documents of a data gathering system. 
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ELECTRON TUBE 

QUALITY a RELIABILITY 
ANALYSIS 



QUALITY CONTROL SPEFICATIONS 

FIG. #5 
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The following is a brief table of contents for such procedures: 

1.0 General Jjxsbructions !; 

The purpose and specific area of coverage is spelled ' 
out in this paragraph. *• 

2.0 Classificatipas of Tests 

A general breakdown of tests into specific groups, bajsed 
on their function in regards to the product, and amount 
of inspection necessary. 

3.0 Sampling Procedure 


Instructions on identifying each unit tested, methods: Of 
selecting each sample unit, and order in which tests ■ 
should be made. 

4.0 Identification andJ^ndlixig of Lots 

Instruction as to lot siM; lot identification, lot 
disposition (accept or reject) after each test. 

5.0 Disposition of Material 

Instruction regarding routing of material that has bean 
accepted or rejected. 

6.0 Records 

A sample of inspection records used with a detailed 
explanation of their use specify data to be taken euad by 
whom, i.e., mBmifac taring or inspection. 

7.0 Tables and Charts 

All tables and charts necessary for this particular :i^ro- 
cedure are spelled out in detail . 

The preceding material has necessarily been brief and probably 
over simplified as a result. We do not wish to convey the thought 
that a system approach is simple, nor would we presume that this 
presentation represents completely acceptable system operation. I 

However, we have found that rudimentary as they are the system 
analysis so far installed by us has very measurably enhanced the 
effectiveness of Quality Control’s assistance tp pnr 14anufactur|ng 
division. 

It is very interesting to note that the tools associated with 
operations research are in essence identical to 
used by quality engineering divisions. 
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The following are some of the accepted techniques; 

Flow Charts 

Measurements 

Experimentation 

Information Theory^ Boolian Algebra^ Gaming, etc. 

Simulation 

Sampling 

Cost Accounting 

This is very reassuring in the sense that it is indicative of the 
evolution of a quality function from the relatively narrow confines of 
parts and processes to comparitively broad system concepts in both the 
techniced and management aspects of today* s manufacturing universe. 



USE OF MANA&aCENf 

Harry G. Rcaaig 

Svinmers Gyrosoope Company " 

U ■■ ■ -■ .. V ... ■ 

It is nacsssary at times to take stock; of our Fr^fe?- 
sion» In what areas are we, What are our weaknesses? 
It is apparent that many Manager consider Quality Engi- 

neering only an Inspection and Test function, a necessary hut 
undesirable and, costly evil that must be suboirdinated "vfeer- 
ever possible. Many Manageuients must still be shown that, 
if set up properly to Include all its functions, it can be 
one of its most yaluable elhs since its functions and^ activ- 
ities should cover , all phases of the probleaus that cbniinua3[- 
ly harass managements. Simple informative reports anh analy- 
ses that aid Management in making valid decisions are! one 
part of the varied functions in Quality Engineering that 
have not received sufficient recognition. 

One point should be stressed. As a true Profession, 
Quality Engineering must become a part of Management , making 
decisions of its own on the basis of reports and directiyes 
from Top Management, such as the Board, of Directors, the 
President aud Executive Vloe President, to the same ektent as 
Sales, Contracts, Engineering, Production, Accovmting, 
Research and Development, and similar departments or divi*- 
sions. Ih turn it provides as one of its functions . rSPorts 
and recommendations as well as servioes tO ail o;yi^;r groups 
as well as Top Mahs^ement that result ih a more ebonomicai 
and efficient operation in all areas reiated to quality per- 
formance. The Customer huys Quality, demands Quality,, and 
must receive Quality materiel in accordance with the brovi- 
sions of each cohtract. To provide adequate Assurancl and 
Reliability, one function is to develop and maintain the 
shortest possible lines of communication aud obtain a, feed- 
back of infonnation. Management Reports are part of this 
function. 

This presentation covers this important function^ It is 
sub-divided into the following 16 items; 

1. Management and Quality Control; 

2. A Two-Way Street— Reports to and from Management; 

3. Missing Elemehts ; *: 

4 . Removing the Rubbish; 

5. How Obtain Good Data?; 

6. Filling the Gap; 

7. How Present Data; 

8. Scheduling Reports; 

9. What an Administrator Should Know; 

10. What a Quality Engineer Should Know; 

11. Overlapping Functions— Responsibilities without 

Authority; 

12. Making the Program Tick; 

13. Ultimate Goals; 

14. Getting into the Act— Making Decisions; 

15. Measuring Results; and 

16. Maximum Benefits tvm- Management Reports. 
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1. MANAflBMEaar AND Q.UALITr CONTROL 

The admlnlstratlTe aspects in equality Engineering have 
been neglected* Quality Engineers have noted this wealmess* 
The Administrative Applications Division of ASQC is its lar- 
gest division* This presentation has been planned to bring 
to light seme of the reasons Quality Control programs seem- 
ingly fade away* It points out how proper use of Management 
Reports in a Quality Control Program can place the Quality 
Engineer in his proper Professional status and make this 
group one of the most valuable in a company in fact, not 
just in theory* 

Impetus was given Quadity Control in 1941 and there- 
after by war-time needs* These were primarily for Accept- 
ance and Rejection Inspections using samples as small as 
possible to save man-power. Although Qxiality Control had 
its beginning in 1924 throu^ the work of Dr* Walter A* 
Shewhart and his colleagues, only a few of the larger cempan- 
ies had made use of these principles and Installed systems* 

In large part the Military used oialy two sampling plans; 100^ 
inspection, or 10^ inspection, and had no definite criteria 
for different degrees of seriousness for their 10^ samples* 
Generally the Acceptance Nimber was zero (0), but was often 
modified in order to accept production in short supply* 
Shortage of man-power and increased production demands made 
it imperative to establish better sampling procedures and to 
evaluate the quality of products prior to shipment. Levels 
of performance were established and sampling plans selected 
that would accept the majority of manufactured parts* 

Managements and the Military established Inspection 
Systems that forced as large a number as possible of work- 
able units out the door each day* Units classed as expend- 
able were built with no consideration for length of useful 
life or shelf life* Fighter planes were expected to be de- 
stroyed early in their life by the enemy, hence were treated 
as expendable and had only essential perfoimance quality 
built in* This same pattern was followed for all such so- 
called expendable units— establish the lowest possible lev- 
els of quality in order to maximize production* 

The levels of quality for these muergency items were 
exceedingly low even for this war period* After the war the 
consumers desired immediate delivery of products of which 
they had been deprived during the war* In this sellers* mar- 
ket quality had no place* Management’s problems primarily 
were procurement and production. Even for stringent military 
needs there were no incentives to build quality products that 
were Reliable and Dependable* Quality Control organizations 
required by the Military during the war period were disbanded 
in many instances. This was especially true of those Quality 
Control engineers not properly trained in tme quality con- 
trol principles and methods. It must be noted, however, that 
much of this change was due to a shift from war production to 
commercial production. Mai^r war-time plants were shut down 
or operated with skeleton crews* The trend was to eliminate 
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ally group that fa.iled to contrihuta to a company more ‘;than 
its cost. Many Quedlty Cbiitrol groups were found wanting. 

Concerns with fairly good quality control systems main- 
tained th^ on a greatly reduced scale, keeping chiefly in- 
spectors and placing most of their other functions in other 
groups. After the immediate needs of the consuiaers wire sat- 
isfied in commercial areas the sellers* market was replaced 
by a buyers* market, The customers egain demanded qui^ity 
merchandise. Managanents had meanwhile added quality 'func- 
tions in other departments. consequently little quality 
control existed and practically no quality information or 
reports. Even the old type of meager Reports oh Civiallty that 
used to be made to Manag^ent and recommendations and Reports 
from Management were practically non-existent. The Military 
set up Procurement Specifications with Quality provisions as 
part of contract requirements, but sometimes these were 
crossed out in many contracts. Paper-wise adherence tjo such 
requirements was usually obtained in some manner. However, 
field reports Indicated that the quality was not as good as 
expected. As a result the Military began demanding s^e 
Assurance of Reliability and often switched contracts -^rom 
one company to another to obtain maximum performance iifherever 
possible for the price being paid. In many cases con|raots 
were even cancelled. 

f! ■ ■ ■ 

Currently the demand for Reliability has become ho great 
that Reliability Provisions are often written into the Mili- 
tary contracts. The stress on Quality and Reliability has 
been so great that many oommercial concerns cite their excel- 
lent quality and performance in all their advertising 'media. 
Both Military and civilian consumers are becoming quality- 
minded. Managements recognize this and now wish inf onilmatlon 
concerning their quality performance. An impetus has 'been 
given to Reliability Programs and also Quality Control, 
Inspection and Test. Quality Assurance Programs beyond the 
usual contract and consumer danands have been placed I'n oper- 
ation. Managements desire factual reports in order tq obtain 
true measures of their Quality Engineering departments as 
well as other departments. Also they desire accurate [measures 
of the Expected Quality Performance of tbelf products. It 
must now be shown the place such Reports have in well-managed 
companies and how Management may gain most from their !use. 

2. A TWO-WAY STREET-— REPORTS TO AMR MCM MAHA^m^^ 

One of the functions of a Quality Engineering group is 
to keep Management informed concerning the quality of 'out- 
going product, the nature of the complaints received from 
customers, the loss due to scrap, the causes of unsatisfactory 
product, and the corrective measures taken to correct discrep- 
ancies of all kinds. It is also necessary to cover tSe quality 
of products received from vendors and sub-contractors ^ and 
provide some rating system for vendors for use by Purchasing. 
There may be a number of statistical reports covering special 
projects, evaluations of various methods and designs, and 
other features that Management may desire on a regulaf 
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periodic basis or possibly upon request. In some companies, 
idiere there exists no true separate statistical group, (Quali- 
ty Engineering may be called upon to present weekly, monthly, 
quarterly and yearly reports to various executives of the 
C(»apany for their regular use. An extreme case may be where 
the individual members of the Board of Directors and particu- 
larly the Officers of the Company desire definite reports 
provided them several days prior to the meeting of the Board 
of Directors, m one company this regular information was 
obtained on a routine basis weekly with a summaiv report 
prepared prior to each Boai^i meeting. These provided factual 
information covering not only (Quality and Reliability but all 
functions and phases of the Company useful to the Board in 
foimulating the policies of the Company. 

Quality Engineering also requires directives. Hence it 
requires certain Management Reports in order to foster and 
develop its own work to the greatest extent. These Manage- 
ment Reports provide regular information covering the poli- 
cies of the company as they affect the Quality group. Which 
products have priorities, which ones are soon to be dropped 
from production? m what field will effort be made to sell 
new products? Will the standards required be low or extreme- 
ly strict? One item might sell for $1.00 if made on a pro- 
duction basis so that the large volume made results in very 
low unit costs. The same it^ might be produced to sell for 
$10 or $100 if made more precisely or of better materials, or 
might be the same item with more expensive surroundings. A 
good example of this is a watch whose mechanism is of the 
highest quality possible. The watch mechanism itself may 
sell for about $80.00. It may go to one area and have a cheap 
case added so that the selling price is low. The same watch 
works may go to another dealer, one who specializes in costly 
cases. Such finished watches may even sell for up to $1000.00 
where some oases may be set with precious jewels. The stand- 
ard for the watch movement may be the same in both oases, or 
it might be made less stringent for the low-priced watch. The 
standards for the oases will probably not be the same due to 
the great difference in costs and the selling prices. Eco- 
ncnaio quality levels tend to vary with costs as well as with 
complexity for the products or components under consideration. 

The illustration above represents an extreme condition 
but in electronic equipment and the like the same extremes 
may exist. One capacitor may require rigid control over the 
Q factor while another use may be made of the same capacitor 
where Q is not important. Rigid controls would be maintained 
for Q in one case and this capacitor would be given one part 
number, while no controls would be used for Q in the second 
case and a different piece-part number would be assigned. 

Management decides the area in terms of uses and costs 
in which products will be sold. This information must be 
given to other groups in order to set proper economical stan- 
dards for the products as designed. Management may decide to 
expand factoary facilities In order to make certain component 
parts that have formerly been supplied by outside vendors. 
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Which component parts can he made mpit wlibhin 

the plant? Because of inter-relationships between the: compa- 
ny and many other outside companies , it may be hecessajT to 
continue the purchase of many compohents even though they 
can be made Cheaper by the company. Management must be pro- 
vided with all the possible informa t ion oohcem ing quality, 
costs, schedules, availability, and stock. The transi.i|;.ion 
from an outside aouroe to company production or the reverse 
must be scheduled in such a way as not to disrupt the :: 
production processes now in operation. 

One shop may be apparently losing money consistently 
through high costs of production and low sales* Howevjer, it 
may be found that some other ccaapany policy is responsible 
for this seeming loss. For example, a concern made a large 

nvaaber of complex items and also water he ate rs. A oon'iS'tant 

overhead was charged against all shops. This high overhead 
was found to be dne Pc reseapph and development programs in 
other areas and had no coipieotion with the water heaths. 

The heater’s design was frozen. It was veiy simple to make 
and cost very little per unit. However, When the standard 
constant high overhead figure was added the apparent Cost was 
much higher than the prices quoted by competitive companies. 
The company’s hot water heater listed prices were basdjd on 
actual costs plus this high overhead so that their selling 
prices were too high to ocaapete successfully with other out- 
side concerns. Consequently the heater business was extreme- 
ly small. A study of actual overhead costs indicated ,, that 
the heater shop should use a much lower, figb-re, not the aver- 
age for the company as a whole. When costs were set din this 
basis, the unit heater selling price was reduced even , below 
the values given by competitors. A lower price was quoted to 
customers and the heater business started to bo om. This slm- 
ple change in accounting methods and costing made* it possible 
for this heatar iShop to quote prices that were reasonable, 
increase sales and show a profit for the company. Also the 
excessive overhead charges were charged against the proper 
jobs so that additional monies came i n fr om res ea rch ^ to - 
jects. This example emphasizes the point that cost” dhtaes 
well as quality information must be valid in order th^t the 
Reports to Management will have meaning. 

Reports to and from Management covering items that affect 
the Quality Engineering group clarify the problems that must 
be solved. Through shorter and olearer report better co- 
operation is obtained between all groups, if the lines of 
communioation are simplified, maintained open at all times, 
then Quality Engineering is in a position to do a better job 
for the Company. 

3. MISSItTg BLmmTS 

Management often seems so remote f rom the daiTV Routines 
that those working on Reports to Management often fail to rec- 
ognize items that would prove of the utmost interest and 
value to Management, These Missing Elements are woefully 
needed but are often hot available* Ppr example, in father- 
ing scrap information a careful cheok may be maintained 

485 



la all areas to determine the mamher of pieces that are 
scrapped. Records are of such a nature that the tabulated 
items include only information by Station Inspeotion Opera- 
tions so that a unit that must pass five Inspection stations 
before going to stock or to the line is recorded five times. 
The actual number of completed pieces made in the Shop is 
not known, only the total number of units offered for accept- 
ance at the various Inspection Stations, If the soim of these 
units is obtained it represents the nvimber of Inspeotion Op- 
erations, If the sum of these Operations is used for a divi- 
sor for the number of pieces scrapped, where the average num- 
ber of Inspection Station Operations per unit is five (5) , 
the per cent of units scrapped is one-fifth (1/5) or 20^ of 
the value for the percentage scrapped based on units com- 
pleted for all operations. More frequently for many small 
runs of different piece-parts, it is too expensive to main- 
tain complete records for so xaany different operations. The 
data should also contain a tabulation of the number of ; |)ieces 
made and sent to stock or elsewhere. With this information 
the percentage of pieces may be obtained. If this informa- 
tion is not available, this missing element should be sup- 
plied by a final check at a clearing Inspection Station that 
covers all ocmpleted units. The best information concerning 
scrap would be that based on loss in dollars for scrap at 
each Inspection Station Operation. Loss in dollars means 
much more to Management since a large number of pieces might 
be scrapped during the earlier operations and the actual loss 
in dollars might be a very low percentage. 

Reports received from areas of all kinds will contain a 
lot of unnecessary information that could easily be replaced 
by valuable missing elements. The same philosophy holds true 
for the Reports issued to the groups by Management. It is 
often good strategy to keep from anno\ancing an innovation be- 
fore it takes place. However, Management cannot see the need 
of indicating in detail the responsibilities of a new depart- 
ment, the nature of the schedule, a proposed move from one 
building to another and the groups affected, the number of 
units that are made for research purposes only that differ 
from actual production units. In many cases no Reports are 
given by Management, This may result in many idle rumors 
such as; "The Motor Division is to be sold"; "A new Manager is 
to be appointed"; "Several recent contracts have been can- 
celled", The list of such possible rumors is very large. For 
maximum efficiency in operations, all groups should be made 
cognizant of the company plans as soon as possible so that 
time is spent on productive effort rather than attempting to 
determine company policies and what events will soon transpire 
that may affect the jobs and welfare of the employees, 

(Quality information both ways is sadly neglected. Re- 
ports are not made and little information is known as to 
Management decisions, customer returns, causes of failures, 
nature of reports from the field. Engineering action, correc- 
tive measures taken, and the success of these measures. 

Quality suffers from these Missing Elements, 
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4, RMOYIMG THE HUBBISH 

Reports are generally too long and involved. Theji facts 
are cluttered together so that it is difficult to obt^fh the 
key elenvents in the report. Summaries are not given, hv, 
where included, do not properly cover the items. The busy 
Executive finds so little information in these reports" that 
he eventually pays little attention to them. Many firih that 
a single one-page report will be read, whereas a carefully 
prepared report presented in two or more pages is not even 
considered. It is often difficiilt to pick the wheat ^'fom the 
chaff. How does the engineer preparing a report know ^What 
Management actually wants. It is an art to write a brief re- 
port that contains the salient elements and thus gaini^l the 
attention of Management. 

What steps should be taken to remove the rubbish?': First, 
wl^ write a report? Second, what is the objective of the re- 
port? Third, is it necessary to write the report? Haying 
answered these questions and decided that there is something 
vital to cover, an outline should be prepared and the ;' ele- 
ments should be classified as to their importance . This is 
like the Classification of Defects, so familiar to the Quali- 
ty Control Engineer. Are there any Critical items? j^e 
some Major? How many are Minor, and how many merely il^hoi- 
dental? This analysis will show that only a few itemh are 
left that are of Critical or Major Importance. Next, the 
Quality Engineer should put himself in the position of- the 
busy Executive. Will he find the items selected for l^he re- 
port critical or trivial? If the elejnehts pass this test 
successfully then the report should be prepared. If no ele- 
ments are left after this strict scrutiny, no report should 
be made. Possibly a phone call might clear all elments. 

Engineering Reports often consist of a page listing the 
findings that are covered in summary form. This page "is the 
Report proper. Attached will be given the details upon Which 
the report is based, arranged in logical sequence in abcprdr 
ance with the simple, summarized form given, in the basic re- 
port. Even then it may be well to chart many items, tabulate 
many others, and omit many xinnebessary details. Long hen- 
tences that are involved often lead the reader oh ah entirely 
different train of thought. So the Report gives conolsely 
the subject covered, the nature of the problem, the sol-ution, 
the basis of the solution, and the action sought. Thip 
cleansing of reports will reduce the paper-work and also lead 
to clearer thinking and a much better presentation. "L 

5. HOW OBTAIN GOOD DATA? !! 

The Conclusions in Reports to and from Management', are no 
better than the data upon which they rest, what is me'^t by 
Good Data? It is basic data that contain a minimum of" errors 
and pertain to the subject under discussion, some data may 
consist of actual physical measurements; others, of test re- 
sults. V/hat are the errors in such data? The devices used 
to obtain these readings should have been calibrated. 'Their 
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errors should be known. If these errors eu^e large, even 
larger than the discrepancies \mder consideration, the Report 
may be merely a consideration of instrument errors rather than 
a study of the difference between methods, materials, machine 
operations, performance, etc. Individuals may make many er- 
rors. Repeat measurements will provide some measure of such 
errors. 

Much data may be based upon personal judgment. It will 
then be necessary to obtain men whose training is such that 
they will give valid data, Shoxxld you ask an electronic engi- 
neer about hydraulic measurements? Should you ask a dentist 
about bodily ailments known only to those in the medical pro- 
fession? In Quality Engineering the jud^^ent of individual 
inspectors is often used, VThat is Good Workmanship? v/hen is 
a solder coruaection a poor connection? It has been demonstra- 
ted by experts in soldering that they can make a beautiful 
soldered connection without making the connection desired. 
Hence techniques for properly evaluating situations, require- 
ments, machine parts, assemblies, soldering, etc. must be ob- 
tained. In order to properly do this, it is necessary to 
make use of all the knowledge available, and often necessary 
to call upon outside experts. 

Good data will depend upon the standards set for obtain- 
ing such data. In the Shop, models, machine standards, examp- 
les of good workmanship such as welding and soldering, etc. 
will be set up and used as a basis for evaluation. The same 
is true in Assemblies, In market forecasting, a proper con- 
trol must bo established. Hence, one of the chief functions 
in Quality Engineering is to obtain the best possible econom- 
ical standards for direct use. In X-Ray work it has been 
found that it may be necessary to establish two standards. 

One is a standard for taking the X-Ray covering exposure time 
and depth. The second is a standard that represents the 
poorest X-Ray reading that is considered acceptable. To ob- 
tain the latter, it may be necessary to check the perfoimance 
of many border-line oases to determine whether they are satis- 
factory for use and thus establish the limit indicating the 
beginning of sub-standard queility. 

Planned experiments will have to be developed for obtain- 
ing the data in the best possible form. Sample results are 
used as representative of the phenomenon under consideration. 
Care must be taken to obtain truly random samples from the 
total population of events, parts, etc, being studied. If 
data can be obtained that contain minimum errors, it should be 
possible to repeat the procedures followed in obtaining these 
data and secure the same results within a desired narrow band. 
Checks for significant differences may be conducted. 

These data may then be sianmarized and filed so that they 
may be referred to readily. Such data then are the basis for 
the Reports that are to be made. These original data, to- 
gether with a listing of the conditions under which they were 
taken, should be filed. They should be maintained for ready 
access when points in the Reports to Managoaent are questioned, 
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Unless the data are controlled within a reasonable ba|id, no 
V6ilid predictions may be made* Hence good data are a;' necess- 
ity for Management Reports* 

6. Ti’TT.T.TTOfl THE GAP 

Management and many in lower echelons will not believe 
there exists a gap in their administrative struoturesj Most 
Managements believe their systan works and has ho Missing El- 
ements* The Q^uality Engineer, however, soon finds a lot of 
missing items. Data sheets are only half-completed* ' Summary 
Reports are made only upon request . When made, they pftaa 
cannot be completed due to the lack of sufficient goo^ data, 

A month may pass without any action being taken to relieve 
this missing elements condition. The Quality Engiheef must 
bridge this gap. This group must set up procedures to pro- 
vide inter-related data that have meaning. It must be in 
such form that it can be computed readily. There is ho ne- 
cessity in taking too much data but there is sense in;:using 
standard foimis that are easy to follow. There should,: be a 
ocmmon pattero from form to form so that there will ba a 
minimum of error in these data. il ; 

Management wants reports backed by facts. Data ipust be 
in such form that they can be explained and also will' sub- 
stantiate the reports. ¥/hen the reports and the data iseem to 
differ, the validity of the reports may be questioned^ Hence 
Quality Engineering must set up stream-lined forms wihh sim- 
ple directions for their use, that give all the essen|ial in- 
formation, also sufficient supplementary data that nmy? be 
used in special Management Reports, The time require^, for 
making out such data sheets may be greatly reduced if numeri- 
cal cells are provided for tabulating measurements by'dhecks 
rather than requiring each measurement to be written* ’ Every 
part should have a meaning and every line should be o(|mpleted 
in most instances. The inspector or tester will thenlibe ceiw 
tain that he has completed the form. If there are many lines 
to leave vacant except for special circumstances then "there 
will be many gsps that will be discovered tdd late. Missing 
data will be avoided by the use of scientific forms tliat are 
well desired, 

7. HOW PRESENT DATA 

There is an art in presenting data in such a manr|er that 
the reader immediately beocnnes interested in the ploti|re and 
quickly gains the concept that is being presented, sometimes 
the written word is used and sometimes charts and tables are 
added. Many excellent references might be given discussing 
good charting practices. Such texts should be studied and 
also charts and tables prepared by the various groups 'in the 
Depairtment of Commeroe (such as the Bureau of Standard's) , 
Research groups in Banks, Travel Agencies, Technical T'ax 
groups, and the Statistical and Operation Research Departments 
in the large industries. Specialists in these fields he'VQ 
clever devices for attracting attention to those points that 
are emphasized. Advertising agencies present attractive 
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brochures that attract attention and have appeal. They are 
constantly making improvements in their presentations. The 
engineer too often feels that a simple statement of the facts 
should convince the reader. This is not tmie. It requires 
salesmanship of the highest order to prove conclusively to 
Management that certain actions must be taken immediately. 

One engineer stated that he had completed a study where- 
by it was obvious that the company could readily save 
$100,000 annually by making a few simple changes. After pre- 
senting his case he was much chagrined to find that no one 
seemed interested in his work and these apparent savings. 

There must be a dynamic approach to the problem. The facts 
are repeated in so many ways that the busy executive finds it 
impossible to escape considering the case. 

One of the basic rules is that each chart should be 
self-contained. All keys to terms used shotild be on the 
chart. Also its line structure should be pleasing and ar- 
resting. The center of interest must be evident almost at a 
glance. Tables also should not require text material to 
indicate their meaning. 

The presentation must be in simple form. It should be 
as short as possible. It should preferably emphasize one 
point only. It should be in such form that, if action is re- 
qjiired, the nature of the action is clear. Some reports are 
merely informative. One form of presentation that has been 
found extremely valuable is to tabulate the data and note 
such brief reading material as is needed on one sheet and on 
the opposite page on a second sheet, visible at the same time, 
present a graphical chart of the data. Some executives like 
visual presentation; others like tables. This dual presenta- 
tion satisfies both. 

8. SCHEDULING REPORTS 


Management will allow some lag in the presentation of 
certain infoimation. In other oases the data must arrive 
within a few hours after it has been obtained in order to be 
used to the best advantage. If you are speculating in the 
stock market, information that a given stock will soon de- 
clare an extra dividend means that you should purchase this 
stock before the information is common knowledge; otherwise 
the price will increase so much that no profit may be obtained 
from this early tip. Minutes may make a difference between 
obtaining a large profit or practically none. 

On the machine shop floor it is necessary to feedback 
information rapidly if it is found that a machine making 
parts at the rate of 50 per minute is making a part to the 
wrong dimension. The sooner that corrective action is talcen 
the less scrap is generated. 

A careful schedule should be worked out with the differ- 
ent branches of Management so that Reports will arrive when 
they will do the most good. Sufficient lead time must be ob- 
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tained to do the necessary analysis, tabulation and typing. 
Where tbe lead time is extremely short, format should: be pre- 
pared in advance so that the data imy be inserted rapidly. A 
good rule is to keep charts as durpent ap possible. 
make the forms used for recording in such a way that barbons 
of originea data may be used directly, wherever possible. Ex- 
tra transcribings of data require more time and introduce, er- 
rors. Machine and IM runs should oftep. be used bP speed up 
tabulations aadccpputations. V 

Make a . reasohable ,apd, de|'inite,,,epbadule , ,, §nd^, a.d||b|?vt„, ,bp.,. 

this Schedule. . ‘-"•’’■y''-'-'"' ^ 

9. YfHAT m mnEISTRASOR SHOULD KNOW 

This topic may seem impertinent but is given fof con- 
trast purposes. Adisiinistrators should learn from th ^lr Quali- 
ty Engineering department what inf ojm^tidn is aval Jable un- 
der current cohditions. They should knov/ what additional in- 
formation may be obtained at a given cost, they shbdld know 
what information is available in o the r departments to see If 
there is an overlapping of data, of worse yet, a diflefeht 
procedure followed in obtaining certain types of information 
so that tbe final results will be contradictory. 

The Administrator sh oul d Imow what,. information 4-^ nejds 

at certain times and the effort, lead tiine, and cost required. 
He should reduce his demands to something reasonable :: in line 
with budget demands, £l 1 possibieshbft-cutsahd, efficient 
means for. handling data should be permitted, to be used... even, 

though several different departments must work jointly on the 

desired Reports, A program should be established in-line 
with such stUdiea aud,Ponf.er§npes between all groups; so that 
the task for the Quality Engineer is well defined, 4lso the 
Administrator should,, indicate what Reports issued hy Manage- 
ment will he made avaiiable and , when. The good Administrator 
works with and throu^ the Quality Sginiaf. The result will 
be a strong and well co-ordinated program. 

10. VJHAT A O-UAim EHGIHEER SHOULD KNOW , 

Quality Engineering requires the utmost diplomacy. It 
is necessary to know how all the other groups function within 
their own departments so the Quality Engineer can coptrihute 
most to those areap wbere .tbsy must, of necessity, consult 
with him and obtain. his decis ion s. Jha Quality Engineer must 
know in general the technical details related to ajl^ products 
made by the company, V/here these vary greatly , ' scmetimes 
only products from .specific shops need to be known. ;■ He must 
know materials, processes, methods, statistics, physics, pro- 
duction, inspection, mathematics, specifications and’; oftau 
Military requirements and documents, contracts, inspection 
and test methods. In particular, he must he a Speoii^ist in 
an area he likes best. Above all he must be qualityfmihded. 

It is absolutely necessary that the Quality Engineer 
know how to prepare meaningful Reports. He must kno^ how tP 
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analyse and sumnarize data in such a way that Management will 
fully understand the text and context. He should know how to 
prepare simple forms , yet complete enough to provide all the 
data required. He should know how to make clear, self-con- 
tained charts. Also he should know Design of Experiments, 
Analysis of Yariance, Correlation, some aspects of Operation 
Research, so that he will he able to assist Research and De- 
velopment, Production Engineers, process Engineers, etc,, and 
also provide aid to Management in the field of Management. 

He should be able to assist Management in formulating pro- 
blems in such a way that solutions may be obtained through 
the use of Operation Research techniques. He needs a sixth 
sense to secure the factual information and comparison data 
necessary for Management to make the best possible decisions* 


In addition to these qualities and talents, the Ciuality 
Engineer must be a good supervisor. He must be willing to 
take orders, and in turn must be able to outline clearly to 
bubordinates what is required. He must be able to work with 
people in the shop and also those in Management. It may not 
be possible to obtain all these excellent traits and abilities 
in one individual. However, a group of Quality Engineers may 
be put together, similar to an Operation Research Team, that 
will have as a composite most of these abilities. With such 
personnel it will be possible to establish Quality Engineering 
on a true Professional basis. Managaaent will have a high re- 
gard for such a group and will give them strong support as 
long as they keep within their field. A rapid survey of 
such a group is obtained by checking the Reports they issue. 

If these are simple, clear and concise, and also are in de- 
mand by other departments, then it may be felt that the Qual- 
ity Engineering department or division is successful. 


11, OYERLAPPIHG EDKCTIOHS RESPONSIBILITIES VifllHOOT APTHORITT 


From the description of Administrative and Quality Engi- 
neering functions in the two preceding sections it is clear 
that functions in any company assigned to any one group must 
be carefully differentiated and separated from the functions 
in other groups. There is a tendency in many companies to 
have a number of groups that work along very similar lines. 
Their duties tend to overlap so that some action started by 
one group may be partially covered by another group. Engi- 
neering may have a Reliability group. At first they just 
assist the design engineer, but after a short period of time 
they take over policing of production lines "to obtain good 
engineering information" of course. Their actions may often 
be in conflict with the independent Quality Control group. 
There may be a Statistical group or an Industrial Engineering 
group that finds itself under-loaded so includes without con- 
sultation or assignment reports on the activities of other 
departments. After a tirae two or three groups have many 
functions and work in process that are essentially alike. To 
overcome this it is necessary to clearly define the work of 
each group and the limits of. their functions and also their 
activities. 
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Vfhen the duties of (Quality Engineering are not clearly 
defined by Management, the stronger groups with somevitoat 
more authority will taka over some minor Quality responsibil- 
ity. V/here Quality Engineering has the task but no authority 
to perform the task, it will be glad at first for supji co- 
operation. It, in turn, may be assigned work that should 
have been given to another department. Engineering is sup- 
posed to nui the Qualification Tests and provide Quality 
Engineering with the data. Also it is advisable to ate Sign a 
Quality Engineer to observe all qualification tests. Who 
then must prepare the test data and test procedures in accord- 
ance with the requirements of the custraaer? The Engineers 
may expect Quality Control to do this, or may elect to do it 
without oheoking with Quality Control. Since these Qualifi- 
oatioii Tests are so nearly like the tests in production and 
inspection and also must be performed by Quality Control on a 
periodic basis, then Quality Engineering should evaluate all 
such tests. It should also work with Engineering on 'standard 
forms for use In preparing such data for the use of Elastom- 
ers. Customers, especially the Military, look to Quality Con- 
trol groups for quality information on models and prototypes 
as well as final production units. If Quality Control is 
held responsible for the final acceptance of units, together 
with Inspection, it must have the authority to obtain all pos- 
sible test data on the project and also be in a position to 
conduct independent tests for verification. 

Overlapping functions must be avoided. Authority must 
be assigned to the one given the Responsibility for ts^rforming 
the function. Quality Engineering must 6 arfy its full load. 
When these functions are distributed to other groups^ many are 
never covered, contracts may not be met. Management suffers, 
and Quality Engineering loses its Professional status. 

12. MAKBfG A PROGRAM TICK 

If the lines of ooramunioation in an army fail, lihe strat- 
egy planned will fail. The same is true for a Qualify Control 
Program. The System must be simple but effective, lilnes of 
communication xmist be clearly outlined, forms for oftalnihg 
action for all the functions must be complete and provide all 
reinired information in a manner that makes it possiple to 
use in later reports. The liaison with other groups must he 
maintained but must operate through designated channels. All 
Reports from Management must be sent directly to the -Quality 
Engineer responsible for the action requested or who is to 
use it in the preparation of a composite report latef. 

The Reports to Management must be so prepared that they 
indicate the progress that is being made and the decisions 
reached. They should tie the program together so thft any 
outside concern that wishes to evaluate the program Will know 
that effective controls are being maintained on all i|'U-all'ty 
functions. Customers must feel that the quality of their 
purchased products is being monitored at all times, ^Rating 
systems should indicate where controls a.re strong and where , 
weak, V/hen there is true teamwork between all groups and all 
areas are operating smoothly, then one may be certain that the 
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Program ticks and is truly effective* Cost analyses will 
corroborate this. Such checks will show that quality is being 
maintained at economical levels with minimxjim expense. 

13» ULTIMM*E G-QALS 


If every function v/as performed without error, the de- 
signs were perfect, production made all parts to print, sys- 
tems v/ere assembled perfectly, all tests were met with wide 
margins, then the outgoing products should approach lOOfo per- 
formance. If studies indicated that test, performance, field, 
shelf and storage life met all the demands of service, then 
there should be 1005^5 Assurance that the Reliability was lOOjS. 
This ideal condition is the ultimate goal. 

Since perfection cannot be attained, Quality Engineering 
may be satisfied if a large percentage of the functions are 
under control so that inspection and test may be minimized. 

The program will provide valid measures of Reliability for 
components, sub-assemblies, assemblies, end the System as a 
v/hole. A minim\mi amount of testing vjill be required and 
there v/ill still be maintained adequate Assurance that the 
Reliability specified is more than met. 

14. GETTTOG BITO THE ACT ^I^IAKTOG DECISIONS 


The last two sections have presented an Utopia. Since 
Quality Engineering is far from these goals and many programs 
are in trouble continually, it is necessary to see what can be 
done by Quality Engineering. Management must be made aware of 
the important part that Quality Engineering can play in a 
good Management program. If good Reports present all phases 
of the activities of a strong Quality Engineering group, all 
groups will be forced to arrange their programs so that they 
may assist in the effort to reach the ultimate goals. If the 
Quality Control group is weak and is doing nothing but trou- 
ble-shooting, then the Reports should be made in such a manner 
as to sell a true Quality Engineering program to Management. 
This program should include all functions normally included at 
other companies under Quality Engineering in order that sav- 
ings in inspection and test costs may be realized and that 
finally the Quality Engineering Division is firmly entrenched 
in the organization of the Company. 

V/hen Quality Engineers are found to be sufficiently ma- 
ture to be completely trusted with their responsibilities, 
then they should assume more responsibilities step by step, 
and check the validity of the decisions they make. In the 
past Quality Control and Inspection have been considered 
merely as service fxmctions. If true Professional status is 
to be obtained, then they must accept certain responsibilities. 
The executive that is most successful is the one who makes the 
least errors in his decisions. He is an executive because he 
is willing and able to make decisions. Quality Engineers are 
usually not in that position. Too many times Quality Engi- 
neers are permitted only to recojnmend while the decisions to 
be made are left to other groups, such as Engineering, Pro- 
duction, and Purchasing. 
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V/hen the 4ay comes when Management recognizes that Qual- 
ity Engineering has an area for which they are responsible 
and that it is capable of making decisions the same ag; other 
groups, then there is beginning a little spark of recognition 
for the group. Reports to Management must reflect this so 
that Quality Engineering may quickly develop into a Pifefes- 
sion and not be merely a service organization. 

15. MEASURING RESULTS J' 

Q,uality Rating Charts were mentioned . earlier# Rejports 
should include measures of performance for all the depart- 
ments and divisions. Numerical measures of performanqe 
should be pbt^ned. In iil lns'pec€I6n'“ar'eas some fori| of 
Classification of Defects should be used. Some will ^e sim- 
ple; others will be more complex. The Demerit Rating System 
is one of the best, it may be used for both Attributes and 
Variables data. More variables data must be obtained jand 
more uses made of such data. Measures of Reliability wltii' 
given Degrees of Belief or Assurance must be obtained^' These 
may be achieved through the new Positive Approach to the 
Reliability problem, wherein by almost continuons analyses a 

pattern of Reliability is obtained much earlier and at 

minimum costs. 


Quality Reports may be condensed into Rating Chart a that 
will present true measures of parfoimanoe. All fimct|ons 
must be oovered. fhe truly effective Department will be the 
one that shows Mahageiment in Dollars and Cents the , sayings 
they have effected, shows the cost of their operation; shows 
what can be done to obtain more savings and presents ft pro- 
gram for future growth in line with past performance. Obtain* 
ing nxaaerical values for the intangible items will require 
much ingenuity. It can be done. Management would like their 
Reports to reflect Results attained. 

16. MAXIMUM BENEFITS FROM MANAGEMENT REPORTS . 

Consideration of the factprs ooyer^^^ in the preceding 15 
sections shows that Quality Engineering has a long way to go 
before it can show Management that it truly has Professional 
stature. The goals ere there. The attaiinaent pf the^e goals 
has been slow and scmetlmes negative. 


Maximum benefits will be Obtaingd by Management from 
Reports submitted to them when they are placed in constant 
use. If these Reports are considered valuable, then, when a 
Report is not received it will be, missed and a request will 

be received for the missing Report. Each Company will have 

different types of reports to fit the needs of each, ihpse, 
v/hich will be demanded by Management will be the P.eports that 
provide a bird’s eye view of all activities in the Company 
with very little effort required from the executive, ; Other 
Reports providing factual information from which Management 
may reach proper decisions should be prepared so that they 
will be used as one of the key factors in reaching final 
decisions. 
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Many companies have excellent Beports prepared regularly 
by their Quality Engineering group. They portray Customer 
Complaints, and Current Quality for all products from all 
shops, departments and divisions. They indicate completed 
action items, progress of those now trader consideration, and 
contemplated actions. They may even show market results for 
competitors and some measure of their quality in comparison 
with the company's own products. Use is made of Summaries, 
Tables and Charts, In one company a weekly book of standard 
reports was condensed to less than ten (10) pages. Manage- 
ment must see its entire field of activity quickly and clear- 
ly hour by hour and day by day. However, weekly, monthly, 
quaiterly and yearly results must be used as adjuncts to the 
daily reports. They make a successful reporting system com- 
plete. Trends and long range planning are based on these 
P.epoits, The Reports, above all, must not be too elaborate 
and must be presented in concise form. Their form should be 
such that they may be used in making forecasts of future 
performance. 

Reports that are used and in demand will be those that 
have Maximum benefit to the Company. Pew are trained to pre- 
pare such gems — -factual, clear, accurate and concise. Each 
Quality Engineering group should strive to provide the best 
compact Reports possible for their Management, If they are 
used, such efforts are tinxly fruitful. Quality Engineering 
then may use Management Reports as a means of obtaining true 
Professional Recognition, If such standing is attained, then 
their Reports will in turn for many features be truly Reports 
from Management, 
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STATISTICAL AIDS TO 

Morris H, Hansen and William N, Hurwitz 

Bureau of the Census ^ 

One of the major functions of an executive is that of imking; 
decisions o Although a large proportion of these decisions can 'be-, 

"based on information, many of them are "based on intuition* Given 
sufficient factual inf oimiatipn, many of the decisions that otherwise 
are time-consuming "become automatic and need not divert him from 
issues in which qualitative judgment is essential* 

Most decisions which concern the executive can be reached more 
quickly and effectively by a knowledge of relevant facts, for such 
decisions the necessary information may concern the internal opefia- 
tions of the business, the activities or characteristics of h^^^ 
customers or dealers or of his potential market, or even more geheral 
external types of informationo The required informatipn may involve 
experimental work for evaluating the effect of alternative metho(^, 
selection^ or treatments. It may Involve operations research, and 
require formulation of models and the evaluation of expectations and 
probabilities associated with alternative events. Sometimes the ‘^prob- 
lem is one of assembling statistics from existing sources j often It 
involves the collection of completely new information. 

In assembling relevant information or, evidence the statistician 
has methods at his disposal that can be applied with great effective- 
ness in acquiring sufficiently accurate information at low cost ^nd 
with great rapidity. These methods include, among others, modern 
sampling, principles of experimental design, and quality control* 
Statisticians also contribute to executive decisions by examining 
problems in collaboration ^th^^.s^ matter specialists or adminis- 

trators to determine, the kinds of factual evidehce that may be of 
assistance, and formulate data collection and compilation methodp to 
yield needed infoim^tip?^- 1^ of these sltuatlpns, the statistician 
carries the principal role in the d.eslgn of methods for assembling 
infomation and guiding in its intei^r station. 

As an example, the data, on the . Inter^^ operations of a modern 
business or governmental organization are usually so well recorded 
that there are tons of paper reflecting its activity* In many " 
instances, much valuable Infori^tlpn is buried^ i^ ;^aper 5 

but synthesizing the information into some useable form often be'pomes 
a matter of great cost because of the sheer magnitude of handling this 
volume of paper, containing thousands or even millions of numbers. The 
individual pieces of paper may have to be classified into meaningful 
categories , - arithmetical operations may have to be performed oh: them; 
or they may have to be reviewed for completeness and consistency;. On 
the other hand, more difficult problems are often presented by the many 
activities of an Pi'ganization on which records or descriptions afe not 
available, despite the tons of paper work that are created, Diij'ect 
observation or collectlpn of infoimiation must be instituted if factual 
information is needed* Perhaps these remarks are sufficient to ‘Indicate 
that the process of obtaining information within a business organization 
is in some ways similar to the chief function of the Census Bureau* 
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Since our major produce Is information, ve have had considerable 
experience in collecting and processing data and have given a great 
deal of attention to applying and creating better methods in this 
field. We consider one of the most important steps has been in the 
direction of achieving an atmosphere in which creative thinking can 
thrive. We believe that this has been facilitated through the form of 
organization structure ve have evolved at the Bureau. 

An organization in existence over a period of years tends to 
develop traditional ways of performing its functions . Improvement is 
often slow and evolutionary. However, major steps forward must of 
necessity break with tradition. The classical organization structures 
in which research personnel have staff status are not always very 
effective in utilizing the results of research because of natural re- 
sistance to change on the part of operation personnel. On the other 
hand, it is very difficult to imagine research in a line role. With- 
out the interchange of ideas between operating and research staff, how- 
ever, traditional methods often become embalmed and progress stymied. 

In terms of our own experience, we have evolved a hybrid organi- 
zational structure at the Census Bureau which represents a break. with 
classical traditions of organization theory. We have a Statistical 
Research Division which has primarily a staff function and almost 
every one of the subject-matter divisions has a Statistical Methods 
Branch with a line function. The personnel, although principally 
mathematical statisticians. Includes psychologists and other 
specialists. These people are not interested in theory alone, but in 
the application of theory to specific operational problems. The most 
important characteristic of these specialists is a versatility which 
not only gives them an interest in a large variety of problems but 
also permits them to deal competently with most of them. 

The distinction between staff and line functions of the Statistical 
Research Division and of the various Statistical Methods Branches is 
not a rigid one. Moreover, each Branch chief has a dual responsi- 
bility; he is administratively responsible to the Chief of his subject- 
matter division and technically responsible to the Chief of the Sta- 
tistical Research Division. Although this may seem to violate 
principles that have been enunciated in classical texts on organiza- 
tion, modern theories of organization have been gravitating toward 
acceptance of this concept. In our own case, we have found that this 
kind of system works extremely well. 

In many respects not only the research group but the entire staff 
of the Bureau of the Census works on our research problems. This, 
in a large measure, is a direct result of the organizational structure 
of our research function. ' This is true because of the give and take 
between those responsible for programs and operations and the research 
group who tend to be the exponents of change. Since members of our 
research team do not have a day to day operating responsibility they 
are free to ask questions directed at Improvement of programs and 
operations. Theirs is a responsibility to ask questions. Of course 
they have the authority to do so as well; but I emphasize responsi- 
bility to ask questions. The Important thing is that the research 
group is a versatile group with a duty to inquire into what is behind 
what we are doing, to learn why we are doing it, and to see what 
techniques are available or can be developed for a particular job. 
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Most of us are av^re of the confusion which might arise if : a group 

with- primarily a research function were permitted to comunicat^^^^^^^^^^^^^^ 

findings directly to the production line in the form of orders, -j In our 
^Judgment, the things that make this approach exceedingly effective are* 
(a) the central research group cannot issue orders hut works , t^ 
persuasion; (h) the high caliber of the research group; (c) thei'free 
exercise of the authprity to ask questions without fear of appearing to 
be naive in raising foolish questions about things that have 10% been 
"proved'Vby custom or tradition, (d) the recognition that criti(j|is 
most effective when accompanied by constructive reconpendat ions -jor 
alternatives; (e) the high caliber of the executive staff of th^ Bureau 
and its strong support of advanced methods , and good administrat.ion; and 

(f ) the presenc e as a member of the^, exe.cut,iye P’^,. 

the research group. While the executive staff of the .Bureau of the 
Census are strong supporters of advanced, methods, the burden of, proof 
that a new proposal is superior tends to be on the personnel advocating 
the change. The principles we have outlined provide the necess%y 
stability for proper functioning of our organization, but with d sensi- 
tive reaction to potential advances, that , may be available. 

As a result of the int,.era,ct ion between ,. the % the 

one hand and the program and operations groups on the o.ther, thp 
statistical research program has had an important effect on Cen|.us 
methods^ not only directly but also indirectly by stimulation ot other 
groups within the Bureau. As a result of som,e of . this research^ 

Censuses and surveys are now made in, ways which are significantly better 
than those used .in, the. recent ^ past. Many of the methods we havp devel- 
oped or applied are potentially applicable in areas where statistics 
can be of help to management. 

Let me illustrate by describing some of the applications pj statis- 
tical methods to : Census problems developed jointly by the resea%h groups 
and other members of the Census staff. In developing and applying these 
methods our purpose has been to achieve a, product that is of the desired, 
quality, at minimum cost. In some cases, the proper balance of .the 
expenditure of resources with, the <iuality of the product means ihat the 
accuracy should he decreased at some points, and increased at p|hors. 

We feel that it is not wise to, turn put information which is more pre- 
cise than is needed. It is frequently true that Important savings can 
be made because the marginal gains in accuracy that can be achi%ed after 
certain levels have been, reached often come at . very high prices^ 

Among the activities of the statistical research, group of the 
Bureau, sampling research and applications occupy an Important position. 
Sampling is the field in which this res organization began its 
work, and from Which much of the basic philosophy of our program arose. 

It was the extension of the phi^^ statistical work that', was 

created in sampling research and applications tha-t provided the; basis for 
the present state of development of the design of efficient surveys and 
of the measurement and control of errors one 

of our basic principles has been to use methods which yield objective 
measures of precision of the results. This is accomplished through the 
use of probahility sampling methods. By using these methods 6 ^: sapling 
we can obtain from the sample itself a measure of the magnitude: of the 
difference hetween the results of samples of the size and type Used, and 
the results of a complete census taken under ,es sent ia^^ the s%e condi- 
tions. When we limit ourselves to probability sampling procedures, the 
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mathematical theory is a powerful guide in the effort to achieve the 
maximum precision of results per unit of cost. 

With the aid of this versatile tool^ more information can he 
obtained for a given cost. As an example, in our Decennial Population 
Census, basic data like sex, age, and race, are collected from' all 
people in the United States. Information on Income is collected 
only from a sample of the population. Sampling permits us to obtain 
the information at a reasonable cost and on a faster time schedule. 


Sampling is applied as an administrative control in the Bureau 
as well as for the collection of sample survey or Census data for 
publication. A sample can furnish more timely information than can 
be obtained from the complete processing of records. Running ex- 
penses or the nature of operations of a department can be obtained 
almost up to the minute by a sampling procedure whereas accoimting 
processing of all the records might be too expensive and badly out 
of date. As an example, during our 19^8 Census of Business we had 
308 field offices supervising some 35,000 enumerators collecting 
infomation from business establishments throughout the country. We 
had a procedure for collection which represented an improvement over 
prior procedures . There were still some questionable aspects of the 
final procedure, however, which required that we keep a close watch 
on the operations so that last minute changes could be made. In 
order to do this two small samples of offices were designated. 
Expenditures in a sample of I5 offices were watched through sample 
time studies of enumerators and office operations. At the same time 
the procedures were critically observed in another sample of 20 offices. 
On the basis of very early returns from these samples, changes were 
made in the procedure which enabled us to complete the job within the 
budget allotted. Had we not had timely information from these two 
samples, we would have learned too late that we were spending much 
more money than allotted for field operations. This, of course, 
would have resulted in a curtailed publication program of business 
statistics. We have found numerous opportunities for such effective 
application of sampling. 

A paradoxical advantage of sampling is in the Improvement of the 
final accuracy of measurements. It is well known that sampling errors 
are introduced into estimates compiled on the basis of sample returns. 
It is not so well known, however, that under certain circumstances the 
basic data can have a higher degree of accuracy because it is possible 
through the use of savings due to sampling to concentrate on obtaining 
better accuracy on the basic data. An example of this effect is 
afforded by the 19^8 Census of Business . This Census included a series 
of questions on commodities sold. It is difficult to get good re- 
sponses to these questions because usually records do not exist in 
the individual retail establishment that give sales by commodity or 
by commodity class , In past Censuses of Business we found that we 
had to stop a good deal short of getting complete schedules when we 
tried to collect this information from every establishment. We found 
that after we had decided to ask these questions of a sample of 
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estalDlishments we iricreased the response rate for these items froiJi 
about 60 or 70 percent to more than 90 percent. Because we verb deal- 
ing with a sample we were able to insist on callbacks and to take pther 
steps to increase the accuracy. Thus we were able to get considerably 
more accurate results. 

An area which is of interest where basic information is siibject 
to the vagaries of human memory, estimate, or conjecture is that of 
response errors. The measufement and control of response errors In . 
censuses and surveys is one of our newest developments. In particular, 
one of the most note-worthy activities is the effort since 19 ^ 5 ; to 
evaluate the accuracy of the results of the major censuses by m'eans 
of sample surveys. Starting with the 19^5, Census of Agriculture we 
have adopted the policy of making such a post- enumeration survey for 
every major census. This work involves the selection of an apjliro- 
prlate sample and a revisit of the sample households or establishments 
by carefully selected and highly trained enumerators. These enumer- 
ators are paled by methods that permit them to spend more time In 
carrying out their work and to use extremely intensive questioning on 
selected topics, in order that we may be able to evaluate the accuracy 
of the data originally obtained. ■ 

There are two purposes in carrying out such a post -enumeration 
survey. One is to determine the errors that occur and their sources 
in order to develop economical corrective measures in future snirveys 
and censuses. The other is to evaluate the magnitudes of the eirrors 
that occur in order to guide the users of Census data. On the basis 
of knowledge of the reliability of the results, users should be’ able 
to employ these data in a valid way without attempting to draw :: 
inferences or to formulate policies not Justified by the level bf 
accuracy of the basic data. 

The surveys that yield the measures of the quality of the pensus 
are not themselves perfect, Just as the Census is not perfect . How- 
ever, we can and do employ in the post- enumeration surveys much mOre 
accurate methods than is economically feasible to use irt a complete 
census. We have also made it a practice to evaluate the qualitj^ of 
the post- enumeration survey itself by means of a subsample thab: is 
inspected by members of our own staff, and by means of a careful 
examination of various aspects of the survey by the staff. 

Another way in which statistical methods can be applied is: in the 
control of the quality of information processing operations. Tradi- 
tionally, the office operations on the schedules collected in, surveys 
and censuses had been carried out with the not Ipri that perfection must 
be attained in each operation. This has usually implied the co|iplete 
verification of every operation, and sometimes more than a single 
Verification of an operation. Our philosophy in this connectiop now 
is that we must have a rational balance between costs on the one hand 
and accuracy on the other. By the introduction of verification;; on a 
sample basis and the use of statistical quality control methods', some 
standard and others new, we have attempted to achieve this balance. 

This has meant decreasing the accuracy of the office processing^ to a 
level commensurate with the accuracy attainable in other aspects of 
processing. The methods of quality control that are used are spch 
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that they give results of specified accuracy hut at considerably 
lower cost and with a faster time schedule than would be possible 
otherwise. As a consequence, we have been able to transfer some of 
the savings into the work of Improving quality where such improvement 
is needed. The principal area in which such improvement is needed 
is in the original collection of the data, 

A sampling application which has been known for most of this 
century but only recently has been getting the attention it deserves 
is known as work sampling or ratio delay. By sampling in time, it 
is possible to obtain Information on operations quickly and effectively 
which would be difficult or impossible to get without sampling. One 
of the most useful applications of this method is to obtain a distri- 
bution of the time required for various elements of a Job. This 
information frequently leads to redesign of an operation with the 
proper stress on its essential aspects. 

A tool with which many of you are probably very familiar is 
design of experiments. It is possible to evaluate through experiment 
alternative procedures, methods, and equipment. In spite of it being 
so well known, it is worth mentioning that it can be used in the field 
of Information handling as well as in manufacturing operations, 
although on occasion comparison of the results of human effort may 
be quite difficult or impossible to interpret. 

A method borrowed from the physical sciences and becoming more 
popular today is the construction of mathematical models. The 
mathematical model represents a process by characterizing its 
essential features in mathematical symbolism. Its great advantage 
lies in its synthesis of the characteristics of the process into a 
formula or set of formulas which the mind can encompass and under- 
stand. In this manner, it is possible to study how the process can 
be controlled or manipulated. We have done some work in this area in 
creating models of verification processes which enable us to under- 
stand the process and to make better decisions regarding methods of 
quality control. We have also constructed a model of Univac opera- 
tions which enables us to decide more economically when to consider 
the equipment out of service and to evaluate and control the effective- 
ness of utilization. 

I am sure that most of you are aware of the mechanical devices 
available for processing information. One of the areas of research 
in which we have been engaged is the development of mechanical 
methods of tabulation, computation, and control of quality. Histori- 
cally, the Bureau of the Census participated in the Initial development 
of punch card tabulating equipment. Hollerith and Powers did their 
early work at the Bureau of the Census. We have our own mechanical 
laboratory and machine shop where we develop, construct, and maintain 
some of our tabulating equipment. We use commercially available 
equipment as well, A comparatively recent development with which 
most of you are probably familiar, is the development of large scale, 
high speed, electronic computing equipment. The Census Bureau par- 
ticipated in the developmental work in the application of such 
equipment to large scale data processing, and paid for the design and 
construction of the first Univac, We now have two Uni vacs in service. 
The availability of such equipment means reduction of costs, accelera- 
tion of work, and increased accuracy of results . 
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Modern electronic computing equipment is exceedingly versatile, and 
displaces some operations formerly done manually as well as those for- 
merly done on punched card equipment. One such use is to displace a 
form of quality control called critical review or, ”edi^^^^ of returns 
or tahulations , During the 1950 and 195^ Censuses, increased use V&C 
made of such methods, thus eliminating some manual processes, p^or 
example, it has heen customary to subject schedules to editing processes 
for internal consistency, making certain adjustments when they a‘re not 
consistent. During the past few years we have been doing some df this 
work mechanically, leaving inconsistencies on the punch' card but' using 
the mechanical tabulating equipment to identify the inconsistencies and 
to permit disposing of them in accordance, with specified rules, ■' Such 
methods have provided a way of decreasing cost and Improving the' thneli- 
ness of the final results* 

Having had some experience with the versatility of modern electronic 
computers, we are moving more and more in the direction of quali-ty con- 
trol on the computers. More editing work can be done on electronic. 

equipment than has been done heretofore on mechanical equipment ‘or : 
manually. Moreover, most recently we have been moving toward the elimi- 
nation of manual ver if icat ion of coding and substituting a coding veri- 
fication by computers. This can be done . only when it is economical to 
■feed to the computer some or all of the information used by coding 
clerks. Although the computers do not catch errors with certaihty when 
the verification is done on the. basis of in^^^ information,; we be- 

lieve that the error rate of the new system will compare favorably with 
that of the old one for a given cost. Conversely, computers mahe no 
clerical errors to which manual operators are highly subject. expect 
many future advances in the application of computers to control bf re- 
maining clerical, operations. 

The examples of the use of statistical methods we have, enujijerated,. 

do not begin to exhaust the potential. Because our time ;is , limited, we 
cannot cover the .entire field. In our opinion, however, the Bureau ^s 

largest single contribution has been the crea-tign of an^^ a^ which 

makes highly competent statisticians willing to forego the more 'lobvious 
advantages of higher income outside the government for the more;! subtle 
advantages in our organization. These advantages are the wide range of 
challenging problems requiring imaginative thinking; the opportiliity of 
a serious hearing no matter how extreme the idea; and the feelirig of 
having made a worthwhile contribution when , a .to useful 

work. As long as this is possible, we foresee our approach continuing to 
generate in the years to come a true science of the collection §nd .corn-, 
pilation of statistics in general which will be potentially of great 
help in aiding management in its decision making process. Moreover, the 
organizational approach we have taken is, we believe, generally" applica- 
ble and can aid in providing effective statistical aids to management in 
diverse activities and organizations. 
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ARMy gjALITY COmOL AMD 

Brig. Gen. A. F. Cassevant 
Department of the *Arniy 


Introduction 

I welcome the chance to speak this morning on a subject that has 
troubled the Array for some time. Too often people are content with old 
programs that appear to accomplish their mission give little ::thou^t 
to the question of whether or not the programs are keeping abreast of 
changing conditions. Abe Lincoln once said: "If we coi;^ fi^^ 
where we are and whither we are tending, we could better judge what to 
do and how to do it - In Pur most recent attempt to keep ourselves 
abreast of the changes occuring around us everyday, we have reviewed the 
Army Qaality Control and Inspection program from three viewpoint^: 
first, why are we doing as we are) second, what does Industry - the other 
member of the Army- industry team - think of our program; and third, are 
we operating in the most economic manner possible that will do the re- 
quired job. In each of these pur review uncovered needed 
changes. Before telling you about the Army’s new look in Quality Cox>- 
trol, a brief review of history and ciirrent concepts is in orderi 

History 

Inspection and Quality Control have progressed immeasurably since 
the days prior to World War II. At that time, most inspection j^ograms 
were considered necessary evils. In a few places however, experiments 
were being made with saii^ling systems, exaimples being the full fled^d 
quality control and sampling inspection activities conducted at Jell 
faboratory and Western Electric, in the military departments and 

in mai^ places in industry, regular use is made of quality control tech- 
niques unheard of in the 1930’ s. Undoubtedly, most of you gentlemen are 
aware of these facts and probably have discussed the topic in detail 
many times. One aspect of the change brou^t about by placing emphasis 
on quality control and inspection leads us to briefly discuss, wjat I 
consider, an important advancement. This is our ability to better 
understaM what specification and contract requirements actually mean 
and what they can do for us. 

Man, all throu^ history, has disliked changing his ideas ajod be- 
liefs. This has been particularly true In his belief in absolui^e®* 
However, he has had to change. For example, not toO uminy decree ago 
man was positive that he could order the making of something, a steel 
pin maybe, exactly two inches long. Of course implicit in this 'belief 
was also a sureness that idlings could be exactly alike. Such beliefs 
were not imreasonable, \dien you consider the f apt that no pne^cc^^ 
measure precisely enou^ to distinguish the differences betwen items 
believed to be exactly alike. Man’s ego led to a desire to believe in 
perfection, especially perfection created by man. 

We have come to accept the impossibility of absolutes in terms of 
size, hardness and similar properties of things. For the most part, we 
seem reluctant to ccpe to grips with the problems of mass of detadls and 
complexity. Our inspection systems of twenty years ago did not measure 
quality of product in the aggregate with precision. Today, Quality Con- 
trol Techniques measure Such quality with hl^ precision. Thesd 
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techniques lead us to understand that seldom is there perfect quality 
in terjus of absolute compliance with specifications, drawings, and other 
contract requirements* I suspect that here is another absolute, falling- 
by-the-wayside, and especially will this be true, if we require economy 
and efficiency* To require perfection in the sense in which I now use 
the term, when we know from experience that we don*t need such perfec- 
tion, amounts to pure wastefulness* During World War II we bou^t, and 
used satisfactorily, billions of dollars worth of supplies that ranged 
from 3/4 per cent to several per cent defective in terms of absolute 
compliance with specifications, drawings, and other contract require- 
ments* 

The precision of our new tool, ” Quality Control,” has in one way 
created problems* As with any really shaip and unfamiliar tool, people 
sometimes get cut idiile learning how best to use it* 

During the days of Inspecting by spot check, and accepting or con- 
tinuing inspection to sort out rejects, the need for explicit contract 
statements regarding the inspection procedures to be used was not appar- 
ent to most people. A few people Mere ahead of the game however. For 
Instance, about twenty-five years ago Mr; Bancker, Vice President of 
Western Electric Conpany, defined specifications during an American 
Society for Testing ^faterials meeting as follows: "Specifications are 
simply definitions of the properties which the purchaser desires* In 
them are his best efforts to state, in measurable terms, properties nec- 
essary for satisfactory use* They include test methods . * • and pro- 
vide an agreed upon basis cf inspection*" More recently the National 
Security Industrial Association in a report on Inspection and Qxality 
Control stated: "It has been observed that most contracts are subject 
to changes and amendments, but very seldom are corresponding changes 
negotiated in Quality Control procedure or assurance requirements* They 
too should always be subject to review and amendment as conditions jus- 
tify." 


These exaziples, and others that have come to our attention, point 
to a growing awareness on the part of both industry, and the Army, that 
inspection and Quality Control procedures are now sharp tools, the use 
of which must be agreed upon in advance of purchase contracts* Without 
advance agreement, one or both of the parties concerned may suffer be- 
cause of a misxinderstanding* 

These changes in the fundamentals of Inspection and Quality Control 
have led to experimentation on the part of industry and government 
agencies* Nbthods of purchasing are being revised, especially as regains 
vendors* quality control systems* I fear that in some instances the 
changes in purchasing practice have been further reaching than is nec- 
essary or desirable* There are pitfalls in racing to keep abreast of 
the times* Military purchasing activities are in danger of becoming re- 
spozisible for contractors* internal management* This is due to the new- 
ness of quality control and to the fact that top management has perhaps 
not had time to become acquainted with its basic principles* 

iEtogtAflBejtf.,AniBr.,aBd. IndMtrT 

Before dlscussiog Amor Quality Control policies and procedures in 
detail, I would like to dwell a little on the division of functions and 
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respoiisibilitles in ttoe Arii^y^Ir^ 

Army subscribes vhole-^eartedly to the concepts set forth in be- 
partinent of Defense Instru^ part: "The basic ;; 

quality assurance conceit of the Departioent ^ Defense is predica^d 
upon the fact that: (a) responsibility rests upon the contractors and 
producing activities for controlling product quality and for offering to 
the military departments for acceptance only -ttiose items or lots ^ 
items considered by them to conform to contractual requirements j and (b) 
responsibility rests upon the military departments for determining that 
contractual requirements have been complied with prior to the acceptance 
of ihe product." 

This division of responsibilities , if fully implemented by both 
Army and Industry, is one vhich will lead to a most effeptiye^^?^ 
supply system. Industry, in a free economy, is particuiarly well! suited 
to decide the best ways and means of accomplishing the economic Pro- 
duction of supplies, whether they are commercial types for con^titive 
sales, or for use in waging warfare. The responsibility, of a mi^tary 
department making a procurement, to insure that contractual rsquirements 
have been complied with, does not in any ytay include responsibiliiy for 
the management of a contractor’s in^erniJ, affairs. to 
procedures have been dictated and established wi^ this cp:^^ in mind. 

Army Policy »md Proeedure 

As I have stated. Army policy dictates that in every way possible 
the vendor should remain autonomous in manageii^ of his business* 
This should in no way reduce the nation Vs strength during mobilizi^t ion, 
since our vendors* day to day commercial pursuits require them toimasd.- 
mize return for dollars spent. Dollars of course represent nothing more 
than man-hours wad materials, the very things that we must conserji/'e 
during a period of mobilization. For l^is reason, the Army Quality Con- 
trol policy governing items which can be factually described and for 
xdaich ye can write def initl^ Q^Q-ity Assurance provisions considers 
that vecdors are responsibla arid have full authority. When such specifi- 
cations are possible, any other course of action violates a basic | pri^ 
ciple of all organized human endeavor. This principle is well stated in 
the "Dictionary of United States M.litary Terms for Joint Usage." In 
this Dictionary the word "responsibility" is defined as follows: "The 
obligation to carry forward an assigned task to a successful conclusion. 
With responsibility goes authority to direct and take necessary ^fction 
to insure success," 

A most important finding of the three pronged review I mentioned 
earlier was the realization that changed conditions could out-date aqr 
purchase contracts due to a requirement that is not adequately described « 
I have in mind clause Je of Standard Contract Form Number 32 . This 
clai 2 se reads: "The contractor shall provide and nmintain an inspjacti^ 
system acceptable to the government covering the supplies heretinlpr. 
Records of all inspection work by the contractor shall be kept c<^lete 
and available to fte g^ the performance of this contract 

and for such longer period as may be specified elsewhere in this icon- 
tract." The question arises as to how to decide when a contractpr's 
system is acceptable. Should we include procedwes and 
actions taken to produce an acceptable product? If this were done we 
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would in fact be violating our policy of holding contractors responsible 
and vesting in them coimnensiirate authority. In order to keep abreast of 
the times, the Department of the Army has decided that contract clause 
5e, to have reasonable meaning, should be Implemented with more defi- 
niteness. This is accomplished, in cases where definite specifications 
are available, by agreeing that a contractor's system is acceptable when 
his supplies consistently meet requirements and when he effectively per- 
forms, as a minimum, the quality assurance provisions of the specifi- 
cations, prior to presentation of supplies for acceptance. In order that 
contractors may completely evaluate costs, the Army has further estab- 
lished basic policy which holds that the Quality Assurance Section cf 
the specification establishes a limit on Ihe maximum severity of Army 
quality assurance actions. This basic policy xdiich covers a major po3>- 
tion of Aru^ purchases is further pursued in Arir^y Regulations and reads: 
"Where there is satisfactory evidence of hi^ quality of production 
which is the definite result of an effective quality control and inr- 
spection system, the amount of government inspection will be adjusted to 
a minimum consistent with proper assurance that the supplies conform to 
the quality requirements established by the prociurement documents.” 

Also included in the regulations are the general details for imple- 
mentation cf the policy. Since under this program sizable contracts are 
many times handled by only one or two Army inspectors, some curb on sit- 
uations that might create surges in the need for Army inspectors is nec- 
essary. Therefore, the Army requests contractors to reduce their system 
to a formal xn*itten form and to agree to give prior notice of proposed 
changes to the system. I want to stress at this point that implementa- 
tion of the Army^s Reduced Inspection Program is voluntary on the part 
of the contractor. 

The procedures I have described apply to all cases where we can 
describe definitely the item we desire and the Quality Assurance Pro- 
visions to be used in determining acceptability. There is another cate- 
goiy of items becoming more and more prevalent in military purchasing. 
These are items like guided missiles, anti-aircraft systems, and similar 
complex, ” on-the-edge-cf^our-technology, wonder weapons." Several pecu- 
liarities become readily apparent with such items. Seldom are they 
ever fully defined. Changes, refinements, and significant redesign 
seems to be the rule, not the exception. To those of you who have 
worked on our regular equipment this may appear to be normal. The nor- 
malcy is lost in this category of items because the changes occur at a 
fantastic rate not experienced in items which have been stabilized. The 
reason lies in their newness and their extreme complexity coupled with 
the urgency of having the item in being. All this leads to inability to 
prepare firm Qiiality Assurance Provisions for after-the-fact acceptance 
inspection. Quality Control from the cradle to the grave is a must on 
these items. For this the Army has published a specification describing 
the requirement for a contractor's quality control system. To date, 
there has been little experience in the use of this or similar specifi- 
cations on Army items by Army organizations. However, a wealth of expe- 
rience has been accumulated by our sister department, the Air Force. 

This experience applies to items that are in many ways similar to the 
Array items, which vrfien purchased, use the general quality control speci- 
fication. The Array Inspection Council has a current project to review 
Air Force experience and to obtain Air Force views and recommendations 
on the use of quality control specifications. The results of this pro- 
ject will be proposals of adaptations suitable for use by Army organi- 
zations on Array items. 
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Sufflaakisa 

In summation, the rapid growth of new ftiallty Control concepts has 
posed problems in keeping up with the times . Army is keeping pac^ with 
this rapid growth and is solving problems as they arise with a minimum 
of disruption of the American way of life. Contractors will stiil^ be te 
charge of their own affairs* Tq accomplish this goal, the Depart^ nt of 
the Army has established a flexible tlnree-f old Quality Control ani In- 
spection program. 

First, in a majority of instances, where definitive specifications 
can be prepared and idiere industry is well versed in quality control, 
Army inspection will be imch reduc^^ Benefits are lower costs, to 
both the Army and industry, smoother relations, and enhanced produc- 
tivity. 

Second, \diere Qiality Control has not been effectively adopted by 
industry, contractors may obtain guidance for their inspection operations 
and information of the government’s procedures. The results will’^be, 
protection of the government’s interests at the lowest cost, consistent 
with the quality offered for acceptance. 

And third, where urgency, newness, and complexity militate against 
defi3aitive item specifications, a Quality Control specif ication will be 
used to assure pptimum control under the special problems such sit- 
uations generate. 

We believe that the Army’s flexible Quality Control and insj^ction 
program is of such nature as to provide maximum economy to the gc^rn- 
ment and the contractor and maxiJmim utilization of the con^^^ 
quality control. 
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QOMmCT BEQUIREiyiENTS AND OJALItCY CONTRCL 

•■■ ■i!- ■■ ■ ■ ■■. ■ 

William K* Ghpraley, Brigadier General, USA !; 

Staff Director, Purchasing & Contracrfcing Policies Division 
Off ice of the Assistant Secretary of Defense 

(Supply & Logistics) ;l 

Quality is very important to the DOD procurement. Without high 
quality materiel, certainly in the weapons ax*ea, and to only a slight- 
ly less extent, in the weapons support area, the Armed Services wbuld 
not only have less than the most dependable materiel but also wpvid be 
required to spend needless effort maintaining the materiel, resulting 
conceivably in failure in battle. Inspection is a technique for assur- 
ing that the DOD secures materiel which meets the specified staadtard, 
and quality control offers a basis for making the engineering jud^ent 
short of an every Item, every process inspection. 

Procurement is the process utilized in the obtaining of supplies 
and services which are required to support the military activities of 
the Nation. These supplies and sex*vlc6s are, as a general mattery, 
supplied by industry. Even in those few instances In which the w 
is performed in a government arsenal, shipyard or maintenance shc^, 
the necessary spare parts and raw materials are procured from industry. 

ii ■ ■ 

In terms of conmodities, the DOD purchases some three mill ion 
items, including, on the one hand, such simple every day commodities 
as hand tools, shoes and milk, and on the other hand, tremendously com- 
plicated aeronautical and electronic items. In terms of sei^icesV 
program includes research of the most difficult type, personal and pro- 
fessional services of almost eyerjr type, and the liJke. ■ 

Our programs sometimes necessitate unique purchases. A liti|Le 
while ago, my attention was called to a purchase of some leeches which 
were required for experimental use. The transaction in question 
sulted in quite a quality discussion - one bidder contending that- xdiile 
the leeches he offered were of the hipest standards, being grown- in 
the purest of spring water, leeches offered by the low bidder 
grown in ” contaminated** waters. 

As a matter of interest, the leeches were being purchased fc^ a 
use which did ncjt require **pure-bred** leeches, the "contaminated**; pro- 
dxxct being quite satisfactory for our intended use. This stoiy shives 
to demonstrate the funda»ntnl purchase to fulfill 

our needs , and we ouj^t to stipulate that quality level idiich will ful- 
filllEEqse needs , so long as that quality level jg reasor^bly obtain - 
able . ■" IV - 

In terms of scope of procurement, the DOD purchasing involves for 
1957, an expenditiare of some 30 billion dollars, broken down rou^y as 
follows (in billions of dollars): 


Aircraft 

6.8 

Maintenance and equip 

1.5 

Guided missiles 

2.6 

Construction 

2 . 

Ships 

1.5 

Research and Development 

' 1.6 

Electronics 

. ..... .. . , 1 . 

All other procurement 

2.0 


Petroleum, oil & lubes 1. 
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As to the number of transactions ^ it may be interesting to note 
that during FI 1956, there were 5*5 million transactions awarded by 
some 1000 purchasing offices located throughout the world. While the 
bulk of these purchases iuv-olved purchase order or other siit 5 >lified 
purchasing methods, the vast preponderance of the money was expended in 
some 100,000 transactions. Every transaction involved the problem of 
product description, or the establishment of an appropriate specifica- 
tion or standard, and included a requirement with respect to the speci- 
fied quality level. Each transaction involved one or more inspections 
to ascertain compliance with the specified q^lity level. This inspec- 
tion was accomplished by approximately 19,CX)0 personnel assigned to the 
quality control supply and procurement elements of the Army, Navy and 
the Air Force. 

Even though a contract is silent on the subject of inspection, 
there is a long history of judicial decisions which provide a common- 
law basis for inspection and quality assurance. Also, in lig^t of the 
fact that most business conducted within the United States is inter- 
state in character, the industrial associations and concerns have pro- 
moted a. ”Unif orm Sales Act” , which Act has been adopted by most of the 
States* This Sales Act includes, of course, many provisions affecting 
both inspection and acceptance as these terms are defined above. Let 
us look at a few principles to demonstrate certain aspects of the prob- 
lem: 


(a) Right of Inspection and Right of Rejection. 

The courts have held that a buyer is entitled to a fair 
opportunity to inspect or examine the article or commodity tendered to 
determine whether it conforms to the contract, that is, whether it is 
such as was bargained for, and if the article or commodity does not 
correspond in kind, quality, condition or amount to that he contracted 
for, the buyer may reject it. Specifically, in relation to the Federal 
Government as a contracting party, it was held (U.S. v Smoot, 15 Wall 
(U.S.) 36 ) that in the conqplete absence of a contractual provision, the 
Federal Government had the right to make reasonable rules regulating 
the inspection of goods it has agreed to purchase, and to prevent the 
perpetration of fraud on it. 

(b) What constitutes Acceptance? 

The courts have ruled that there may be several KINDS of 
acceptances. For example, acceptance of TITLE may be distinguished 
from acceptance of QUALITY . While acceptance of quality and acceptance 
of title are usually cohteRporaneous, there have been cases in which 
the courts have held that even though title passed, the purchaser may 
recover damages or rescind the sale if the goods, upon inspection, 
proved to be of a quality inferior to that required by the contract. 

In the latter instance, the buyer is also given a reasonable time with- 
in which to conduct his quality acceptance. In government procurement, 
this concept is usually covered specifically by the inclusion of a 
guarantee, or more properly, a warranty clause in the contract. 

The above establishes the fact that in common law, as well as in 
statutory law, distinctions are drawn between INSPECTION and ACCEPTANCE . 
In government procurement this distinction is maintained. Bui7"al~ 
though they are separate considerations, they are closely related. To 
show the closeness of inspection and acceptance, both concepts are 
covered in Section XIV of the Armed Services Procurement Regulation; 
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and to show the separation of the two, separate Parts are provided. 

Part 1, covering Inspection and Part 2, Acceptance* ! 

The ASPR definitions continue the distinct ion^^^ Irapection m^ans 
”the examination ( including testing) of supplies and services (includ- 
ing, when appropriate, raw materials component s, and intermediate;: 
assemblies) to DETEMIIJE WHETHER THE SUPPim 
CONTRACT REQUIREMENTS, which include all applicable drawingsV 
t ions, and purchase descriptions.** To coin a phrase, inspection is 
specification enforgegcp^ . , ■ 

Acceptance, on the other hand, is defined as: **The act of ah 
authorized representative of the OoverimiBn^^^^^^ which the Governraeirt 
assents to ownership by it of existing and identified sv^plies. • . :as 
partial or con^^lete performance of the contract. M 
too that the government contract administrator has indicated con^ltance 
with the many other contractual provisions IN ADDITION TO THO® RELATED 
TO THE SPECIFICATIOlir. 

There are many contract clauses which have an influence upon; the 
quality aspects of the contract? ;; 

a. The Inspection Clauses. 

The DQD inspection clauses are very simple in constructipn. 

In addition to the establishii^ of an agreed solution in the evqnt of 
non-conforming supplies, the clauses have two provisions: (i) they re- 
quire that the contractor ” and maintain an 

and to maintain the **re cords of all inspection work... and mak^^ them..* 
available to the Government**, and (ii) they provide that the inatelria.1 
**shall be subject to inspection and test by the Government ..•(.*|* in- 
cluding raw materials, components, intermediate asse^lies, and ehd 
products) to the extent practicable at a!U, times„ aM including 

the period of manufacture *.t** j! 

You will note that the requirements of the clauses are i|ery 
general in nature, and are suitable for general application to almost 
any contract or any materiel. No standard or quality levels are stip- 
ulated nor test techniques specified. The absence of these in th^ 
inspection clause does not mean that they are non-existent, but merely 
that they are supplied elsewhere. They are lupplX<^ as a part of the 
specification or standard, ^ich, of course, are incorporated by'refw- 

ence into the contract, and thus become contractual as between 1>he 

parties. In add it ion, it is to be noted that there is a contract^l 
requirement that the contractor *‘mainta|^” i^pective system Accept- 
able to the government, but there is not provided' inclement ing dic- 
tions with respect to an adequate inspection system. 

b. The Changes Clauses. 

Another contract provision affecting quality and inspecin 
are the ** Changes** clauses. These give to the goverrmierit the uniUt^^ 
right to make changes in **drawings, design or specifications, where 
the supplies to be furnished are tp be specially mariufactui^d for the 
Government in accordance therewith. ••** 
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Lest you believe it unfair that the governraent be given the 
ri^t unilaterally to amend the specification, it should be borne in 
mind that the vast preponderance of all changes are ” engineering 
changes” idiich spring from proposals of the contractors themselves, 
and that, in any event, the parties have agreed to negotiate and 
EjQtJITAHLE ADJUSTMENT in the pricing growing out of the change* This 
situation is Justified, in my view, by the basic requirement that the 
public receive the soundest product possible. I believe, furthermore, 
that all purchasing organizations are aware of the need for “equity” 
in the adjustments in prices growing out of the application of the 
clause. With the assurance of equitable treatment in the background, 
and in order that the production will continue, provision Is made addi- 
tionally to the effect that the contractor will continue under the 
“contx^ct as changed.” In addition, inability to negotiate a suitable 
equitable solution to the change, the matter is solved by an appeal to 
the Armed Services Board of Contract Appeals under the Disputes Clause, 
next discussed. 

c. The Dispute Clause. 

All Department of Defense Contracts, as well as all govern- 
mental contracts contain a Disputes Clause which offers a quasi-judicial 
departmental adjudication of unresolved disputes as between the con- 
tractor and the contracting officer. The net effect of this clause in 
DOD contracts is that agreement is reached between the parties that the 
Armed Services Board of Contract Appeals will hear and determine such 
unresolved disputes, subject to an appeal to the courts if the decision 
is “determined by a court of competent jurisdiction to have been fraud- 
ulent or capricious or arbitrary or so grossly erroneous as necessarily 
to imply bad faith, or not supported by substantial evidence.” In- 
cluded within the frame-work of this clause would be problems which 
grow out of specifications and standards, inspection and quality. 

Over a period of years, the Armed Seirvices Board Contract 
Appeal has merited the respect of both industry, government and the 
legal profession for its fairness axxi equity in the application of legal 
principles to the disputes at hand. 

The independence of the Board, together with the appreciation 
of industry and the Bar Associations of the fairness of the decisions 
of the Board, have largely negated an apparent situation in which dis- 
putes are determined by one of the disputants - the Government. As a 
matter of fact, there are very few cases in which contractors seek fur- 
ther relief in the courts. 

d. Warranty and Goarantee Clauses. 

While there is no guarantee or warranty clause for DQD-wide use, 
the military departments have utilized such clauses for many years. 

The clauses are all similar in import: (i) there is a warranty concern- 
ing defects in material or workmanship, (ii) there is a warranty that 
the item conforms to the specification standard or its intended use or 
both, and (lii) a period is designated during which the warranty is 
effective, usually six months or a year* Warranty provisions are 
generally used on a selective basis in those sit\iations in which the 
government buyer deems that the government needs the additional pro- 
tection that the clause affords. 
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While there are additional clauses affecting quality, such as 
purchase by sample, first item approval, and even the approval cif 
coii^onents pax*ts, I would like to conclude with a discussion of ^aome 
considerations which m lead to a clarification of pur present ’ in- 
spect ion clauses. 

Tou will recall that in the discussion of the inspection clauses 
it was stated that there is a requirement that the contractor maintain 
an inspection system acceptable to the government, otherwise un^efiiied, 
but there is not provided the necessary implementing direction #ith 
respect to an adequate inspection system* In short, a general 4^1i^- 
tion in relation to an inspection system is provided, but no pacific 
contractual standards are imposed upon the contractor in relatipn tp the 
systan. 

In the DOP there is an expanded effort to see to it that the 
contractor uridertake the management of his contract, with at least min- 
imum involvement by government procurement personnel in that ma^gement. 
This general emphasis has taken several forms in the past; 

a* In the accounting field, there is a growing tendency tp recog* 
nize that the management of the contractor includes the responsibility 
to maintain an appropriate accounting system to meet the contractor 's 
needs, and if a gbverhmsntal cost problem presents itself, to mpet also 
the governmental needs* Accordingly, the present tendency is tp pro- 
vide an accounting standard which represents the governmental npeds, 
inspect the accounting system to see to it that the system, in practice, 
provides for those needs, and .thereafter minimize detailed audios and 
rely upon audits idiich reflect continued appropriate application of 
the approved system* 

b* Again, in connection with the furnishing of government pro- 
perty for use in governmental procurement, we have determined ap DOD 
policy to reduce the amo\int of government record keeping which yill be 
done in connection with the property* This was done with the feel ihg 
that the contractor must himself set up a system of accountability for 
the property, and we will stipulate a system for the care of thp pro- 
perty, and administer the system to the extent of assuring application 
of the approved system. 

c* Recently, in connection with the approval of subcontracts, we 
have again applied the concept of the approval of the Contractor's 
purchasing system instead of the pre-existing approval of his indivi- 
dual subcontracts. 

As I see it, this also is the direction in which pur inspection 
actions will move. This will mean t)^^^ will stipulate conti^ctual- 
ly, standards of inspection and will approve the system for con|?liance 
with the standards 5 and will rely more and more upon the contraptor for 
utilization of his approved system. 

As a matter of fact, the Air Force has already gone far in this 
direction in the publication of Standard MIL-Q-5923C(USAF) , entitled 
QUALITY CONTROL REQUIREMENTS, GENERAL. In this Standard, there: is 
initially stated "the general requirements for the establishment of a 
quality control system by the contractor to assure that itiateriajLs , 
supplies, or services meet the quality standards established by the 
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contract.** The standard j additionally, requires that the contractor 
maintain a **written**, fully “planned and developed’* system of quality 
control “based upon consideration of oon^lexity of design, interchange- 
ability and reliability requirements and manufacturing techniques. 

The system shall assure that adequate control of quality is maintained 
throu^out the entire process of manufacture...” 

Of course, it must be borne in mind that a program of the size 
and coii5)lexity of the DQD procurement program above discussed, will 
sometimes require continuation of every item, every process inspection. 
Thus, inspection of the contractor’s system will become one of tools 
in the contract administration kit for such use as may be found appro- 
priate as is also the case in the instances of the accounting system, 
the government property responsibility obligation, and in the pur- 
chasing system area. 

During the course of this presentation I have presented a word- 
picture of the current DOD procurement operation in terms of the size 
and nature of the purchasing program in (i) classes of items being 
purchased, (ii) number and types of transactions and (iii) number and 
distribution of our procurement offices. I have also provided some of 
the D(3D procedures which touch or influence quality and some of the 
current influences which may result in certain changes in the quality 
area. In conclusion, I hope that you will find that the procurement 
quality kit-of -tools is adequate to permit both ind\istry and government 
to perform their respective roles in the shaping of a stronger America. 
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DISCOVERY SAWLim. - REVISIONS AND RESllLTS 

Ervin F. Taylor 

Westinghouse .Electric Corporation 
Atcanic Fuel Department 

Discovery Sampling ty attributes, a vinique approach to sampling 
inspection, is i-vhen properly applied- one of the most efficient' sam- . 
p3.1ng systems in e,3d.stence. T^ technique, developed in 1950, vas 
designed to satisfy the reqxiirements of inspection personnel an4' to 
overco^ some of the objections to other sampling methods. 

Since its initial development. Discovery Sampling has been:;dis- 
cussed at quality control conferences and meetings in many parts of the 
country. Response to the method has been exceptional. The comments 
expressed most often have been, that; (l) Discovery Sampling is not ney, 
but is a statistical expression of "pre -statistical quality control" 
intuitive sampling plans; and (2) non -formalized versions pf piqcoYe^ry 
Sampling are being employed in many inspection operations. 

Following are: a review of the basic Discovery Sampling technique, 
illustrations of recently incorporated revisions, and descriptions of 
some results obtained.. In. there are recommendations tp thpse 

interested in applying the method, and to those who wish to expfilnd sta- 
tistical quality control theory by developing corollary methods. 

REVIEW 

I - No sampling error or risk is involved when the .lot be.ihg 

sampled is either lOOjS good or bad. Sampling risks ocbur only 
when a lot is partially defective. 

II - Seppling risks are inefficiently controlled when 100^ good and 
bad lots are considered, since they have no influence pn tl^t 
risk. Only partially defective lots affect the sampling risk. 

Ill - Partially defective lots constitute, generally, less than half 
of the total lots inspected. The balance consists of ijLppjo good 
and bad lots. 

IV - The fractions defective of partially defective lots possess a 
relatively stable distribution which indicates that 
tions defective are more likely to occur than large f3:^ctions 
defective (Fig. l). 

V - The number of human inspection errors is directly proportional 
to the size of the sample being inspected. 

These are five points which led to the development of Discovery 
Sampling and which form the ixnderlylng theory. The result is a: sampling 
system with a simplicity which minimizes problems of education," adminis- 
tration, and operation. ■ 

The basic .steps necessary to effect a Discovery Sampling installa- 
tion are as follows: 
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FIGURE 1 - PARTIALLY DEFECTIVE LOT DISTRIBUTION 
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1. Make four policy decisions. 

a. Select a target AOQL (average outgoing quality limit). 

b. Select AQL^s (average q-uality levels), if required^ for 
various characteristic classifications (used only In con- 
junction -with the evaluation sample)# 

c. Determine the scope of a particular Discovery Sampling 
plan; i.e. should a specific part number, type of j)roduct, 
entire department's production, etc., be sampled ? ' 

d. Determine the period of sampling control; i.e. should com- 

pensations for changing sampling risks be made daily, 
weekly, monthly, etc.? ■ 

2. Collect five, items of data from inspection records or ,^pecial 

data collection procedures. 

a. The number of partially defective lots inspected. ■ 


b. The number of 10(J/i good lots inspected. 

c. The total number of lots inspected. 

d. The number of lots sample inspected. 

e. Tlie average sample number from lots sample inspected. 

3# Plot the frequency distribution of the pa3rtially defective lots 
in 0.05 fraction defective intervals. Compare the distribution 
with the curve: = A(s+i)(l-p)® using several values'; for s. 

kt Compute the Discovery Sampling sample nimaber from the, Equation: 

a' ^ (s + n'+l) 

" ~ 4(A0QI.) * (5+n'+|)-B(s+l) 

where n = new sample number 
n’= old sample number 

A*= reported fraction of partially defective;; lots 
s =5 partially defective lots distribution pa-rameter 
(usmlly ==3) 

Note: If the AOQL « 0.5^0 and s = 3, the nomographs in Ref# 1 or 
Ref. 2 will simplify calculations . 

5. Establish some regular data collection method for the items in 
(2) above. 

6. Design a flow chart illustrating the steps to be followed. 

(See Refs. 1 and 2.) 

7. Train personnel, using the flow chart. Sampling bowls.' can be 
helpful in training. 
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8. Place the plan in operation; monitoring initially through per- 
sonal contact with inspectors and their supervisors, and later 
hy control charts (X and R) for the sample sizes* 

!Ehe complete Discovery Sampling theory is given in "both references 
previously cited, and in the Appendix to this paper. 

In actual practice instructions to the inspector are quite simple. 

A typical example would he; 

1. Select 8 pieces at random from the lot, 

2. Inspect thoroughly all required characteristics of all 8 
pieces. 

3# If none of the 8 pieces are defective, accept the lot. 

3:f any of the 8 pieces are defective , reject the lot. 

4a. Alternative to (4): Retain the sample and select 92 

additional pieces (lOO total - evaluation sample) at ran- 
dom from the lot. 

4h, Inspect the 92 additional pieces for only those charac- 
teristics found defective in the 8 piece sample, 

4c. Accept the lot if less than 3 of any one characteristic 
are found defective in the entire 100 piece sample. 

4d. Reject the lot as soon as 3 of any one characteristic are 
found defective in the entire 100 piece sample. 

This plan, properly applied, will assure an AOQL of 0.005 through 
(4) above, an AQL of 1.5^ if the alternative to (4) is used, and an ASN 
(average sample number) of 11.15 pieces per lot, 

REVISIONS 

Two major revisions have been made to the Discovery Sampling theory 
since the publication of Ref. 1, These improvements are the OC (opera- 
ting characteristic) curve calculations and the ASN theory. 

Ref. 1 contained OC curve calculations which were rather unconven- 
tional and difficxilt to interpret, A more conventional method was de- 
veloped and appeared in Ref. 2. An example of the new OC curve for the 
sampling plan cited above is shown in Fig. 2. (The theory of the OC 
curve calculations is given in the Appendix to this paper, ) 

An ASN curve depicting the relationship of the average sample nimi- 
ber and the fraction defective of incoming material can be developed for 
most sampling plans. With this curve and a value for the incoming frac- 
tion defective, the average sample number can be determined. 

Discovery Sampling is unique in that Information is obtained on the 
frequency of occurrence of pairtially defective lots. In other words, 
the proportion of lots likely to be received at any given fraction de- 
fective is known. Hence, an average sample number, not a curve, can be 
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calculated for Discovery Sampling, This takes some of the "ifs" out of 
the ASN calculation and permits a much more realistic estimation of the 
inspection work load. 


HE3SULTS 

Evidence at ASQC meetings and conferences from coast to cpast in- 
dicates that most inspection personnel are enthusiastically in 'favor of 
Discovery Sampling. In many cases, where a sound application lias beeh 
made, it has been at the insistence of inspection personnel. The reason 
is apparent. Most sampling plans require sample sizes which appear un- 
reasonably large to the inspector. In fact, the inspector, who feels 
that the sample is too large and who is not rigidly controlled,' will 
sample the sample . The good inspector does, however, sample the sample 
on some rational gro\xnds. He inspects less material from a no^plally 
good supplier, and more from a normally questionable supplier. ' He does 
the same thing with material from his own shop. He has some knowledge 
of the quality capabilities of the man -inate rial -machine combination 
which produces the parts. In actuality, the inspector is estabiishing 
an intuitive probability of occurrence of defective lots and a^ljusts his 
sample number accordingly. Discovery Sampling does the same tl|ing that 
most good inspectors are doing, but on a more scientific basis, ’^ yielding 
sample numbers generally much smaller than those usually encountered. 
This leads to another axiom: Better quality control is effected through 
a thorough inspection of a small sample than a cursory inspection of a 
large sample. These are the primary reasons why the technique is 
accepted so readily by inspectors and inspection supervisors. 

One of the best examples of a realistic test to learn the value of 
Discovery Sampling can be shown by citing the results of Compahj^ X. 

This company had been using MIL-STb-lO^A for some time. It was; decided 
to test Discovery Sampling with a minimum of disturbance to the| then 
current inspection method. 

An AOQL of was selected for Discovery Sampling and ah: A(^ of 
0.65^, inspection level II -normal, was already being emplbj^d fpr Mll- 
STD-IO5A. The Discovery Sampling sample number was calculated at 6 for 
bolts and 9 for nuts, the products selected for comparison. The former 
was used regardless of the lot size; the latter was doubled when the lot 
size exceeded 1000. 

The technique used was to select the MIL-STD-I05A sample aj random 
from the lot, the first 6 (9 or I8) pieces being the Discovery Sampling 
sample. A tabulation of the results is given in Table I. 

A total of 325 lots of bolts (9 to 121,185 pieces per lot) were 
compared. Discovery Sampling duplicated the MIL-STD-I05A results 98,2^ 
of the time with only 7.1^ of the inspection effort. At the 5'j4 level, 
there was no significant difference between the process average esti- 
mates of the two plans. 

A total of 202 lots of nuts (19 to 52,300 pieces per lot), were com- 
pared, Again, Discovery Sampling duplicated the MIL-STD-105A results 
96.0^ of the time with only ih.Tfo of the inspection effort. The in- 
creased amount of Discovery Sampling inspection compared with that for 
bolts can be partially explained by the fact that more than half the 
lots were over 1000 pieces and required the I8 piece sample, ;! 
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TABLE I - TEST RESULTS OF DISCOVERY SAMPLING (A) COMPARED WITH MIL-STD-105A (B) 



•< lO - 
OJt- Ul 

• O OH- 
a: H — O 
uj u.Cj 

ooo-C. 

ac arui 
ZJtOOo 

Z UJ -> 
NtOwk. 


- O -J 
r c»o a. H 

I UJ (rvX (O 
_! •< 

CD CM to UJ 

=>in X 
O UJH 

oo> 

I V) 

Q: H < 

ujO> U 

«- 4 UJ < 

U. u> 

coujo 
z ujo 
M I 

UJ — o 
-J wo H 
O. O bO 
XH»H I 


J z zo w 
E O -« * W 
- CJOC — < 


CM rr\at in 'O 00 



522 




RBCO^MBNmTIONS 

Discovery Sampling is not l>eing touted a,s a panacea for all ' the in- 
spection sampling problems. It does, however, have ^ 
plications# When Discovery Sampling cannot he applied, it will liiake 
this indication. By varying the sample size according to jWie percentage 
of partially defective .lots inspected, and maintaining an X and B chart 
of the re siiltant sample numhers, it soon becomes evident whether ;|or not 
Discovery Sampling is properly applied. Such a. chart refining 

in control after some optimum operation period till indicate tha*j| the 
technique is satisfactory. A chart out of control , i thap some 

investigation should be made. A, study of the situation can of tep reveal 
improper or inadequate specifications, a particularly bad supplier or 
part, or even improper inspection techniques. Once the situatipri is 
corrected. Discovery Sampling can probably be applied. When Discovery 
Sampling fails (only once in the author's experience) it is probably due 
to the process a,nd not the sampling plan. ' 

The control chart test (if performed as Indicated, in the preceding 
paragraph) cein be made quite satisfactorily with a minimum of effort and 
without disrupting the normal inspection sampling operations. n 

Discovery Sampling can be tested, as indicated in the preceding 
section, with little disturbance of the existing inspection raethpd. The 
following procedures are suggested: 

1. Follow the 8 basic steps previously outlined. 

2. Select the Discovery Sample from the first n pieces of the 
usual inspection sampling method. (Select at random frpm lot 
in case of lOOjSi inspection.) 

3. Inspect sample and record results. S 

4. If a defective is discovered, select additional pieces i'rom 
those selected. fQr the usual ,,s^ method until either a 
number of defectives, equal to the rejection number at tjjie. 
selected AQL (Table III) is discovered or until a total;; of 100 
pieces has been selected,, (Additional pieces for the , e^Xua- 
tion sample may have to be randomly selected from the Ipt if 
the usual sampling plan calls for less than 100 pieces.) 

5* Inspect evaluation sample and record results. ;; 

6. Inspect balance of pieces in usual sampling plan and record 
results. t ' 

7* It will be more convenient if a daM sh®®h is established with 
the following column he, adlngs: 

a. Lot number. .;i. 

b. Lot size. 

c. Usual inspection plan sample number. 

d. Defectives, found in (cj above. Note: More than tw;p 
columns for (c 5 and (d) may be required if double py 
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miiltiple sampling is currently used. 

e. Discovery Sampling sample mmiber. 

Defectives foimd in (e) above. 

g. Additional evaluation sample pieces inspected. 

h. Defectives found in (g) above. 

i. Lot accepted by both plans. 

J. Lot rejected by both plans. 

k. Lot rejected by Discovery Sampling; accepted by other 
plan. 

l. Lot accepted by Discovery Sampling; rejected by other 
plan. 

This test, in addition to the control charts of the Discovery 
Sampling sample number, should provide ample evidence on the value of 
the technique. 

Practically the only critic! sin made of Discovery Sampling by in- 
formed statisticians has been directed at the empirical partially de- 
fective lot distribution curve, Pq = A(«+l)(l-p)® . The criticism has 
been tha.t the curve is not theoretically valid and is probably not 
stable, Since this is an empirical equation, the only answer to such 
criticism is to suggest the collection of data to prove or disprove its 
rationality. 

The following recommendation Is made to any statistician who wishes 
to perform an economic service to inspection departments everywhere; 

Discovery Sampling has introduced to quality control theory the use 
of a third probability in sampling -- the probability of occurrence of 
defective lots in addition to the probability of a defective piece in a 
lob (p, the fraction defective) and the probability of acceptance (P^). 
The distribution as described by Discovery Sampling may not be theoret- 
ically perfect. It is reasonable, however, that such a distribution or 
distributions do exist. It is sincerely recommended that interested 
statisticians develop more theoretical bases for the probability of 
occurrence distributions. Work of this type woilLd make an extremely 
valuable contribution to the science of quality control. 

CONCLUSION 

A number of refinements in Discovery Sampling have been made since 
its introduction. Many quality control people are talking about the 
technique, testing it, and applying it to inspection operations. 

Tiirough Discovery Sampling, many inspection dollars are being saved each 
year with a closer known control of quality. 

The strongest recommendation which can be made for Discovery 
Sampling is; It works. 
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Appsroix 


Note : The complete theory of Discovery Sampling is included in :this 

Appendix to place the OC curve and ASN theories in their proper 
perspective* 

BASIC THEORY 

Discovery Sampling considers the probability of occinrrence pf a 
partially defective lot, the actual distribution of partially defective 
lots; as veil as the probability that a sampling plan will accept the 
lot. Consideration of these probabilities determines an averagd* out- 
going quality limit and facilitates the, cons of, pC, cu^es yhere 

the probability of occurrence of a partially defective lot is cpinsid- 
ered. 


Lots presented for acceptance fall 
classes# 


into tliree mutually exclusive 


Class 


Symbol 


Fractipn ...gefective 


100?^ Effective (GDL) 

Partially Defective (PDL) 

100^ Defective (none) 


p = 0 
0 < p < 1 
p = 1 


A lot which is IQOJ^ defective does not constitute a sampling risk; 
since it will be discovered if only one item is inspected. Hence, these 
lots will be excluded from further consideratipn. | 

The probability that a partially defective lot will occur i-s de- 
fined as; the latio of the nwber Pf partially defective lots t-O the 
number of partially defective lots plus the number of lOOJ^ effective 
lots which are presented for acceptance during a given interval of time. 
Symbolically; 


A = 


2:t(PDL) 


111 


ZtiPDLl+ZtlGDL) 

A study was made to deteimiine the distributlpn^^^^^ pajrtially de- 
fective lots. The probability density function 


f (p;sl = (s+ll{l-p)*dp; s>o, o<p<l 


( 2 ) 


was found to represent this data on ,a cpnseryative ba§is^ 

the parameter '’s" determined from the .data was approximately 3.* 

The probability of occurrence of a partially defective lot "with 
fraction defective p may now be defined as; ■: 


Pq = A(s + l)l!-p)®dp (3) 

The probability that a lot with fraction, defective p will tie 
accepted by a sample of size ’*n" with no defectives allowed, is :■ 
approximately; 

Pa= (I-P)" 

* Tiie question arises , would other studies also give this distribu- 
tion? The writer has made many studies of pairtially defective iots. In 
every case Eq. (2) was applicable, although at times very conBe:^tive» 

ly* 
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Therefore, the probahility that a lot vith fraction defective p 
will occur and be accepted is: 

PqPo = A(s+|)(l-p)® + %p (4) 

Assume that for each lot of size k there exists a set of lots of 
size k which have the distribution' defined by Eq. (2). Then the follow- 
ing is true for each set of lots and hence for all sets of lots. 


A lot with fraction defective p contributes to outgoing quality the 
fraction defective: 

FD = A(s+l)p(l-p)®’*'"dp 

And the total fraction defective contributed to outgoing quality 
for all partially defective lots is: 


2:pFD = A{s + |)j'^' p((-p)® + "dp r A- 


s + l 


(5) 


(s+n+|){s+n + 2) 

(Screening of lots in which defectives are found is assumed. ) 


Similarly the total faction effective contributed to outgoing 
quality for all partially defective lots is: 


S;pFE = a[|- ts + l)/J(1-p)*pclp] = A 

Also the total fraction effective contributed to outgoing quality 
for all lOQffo effective lots is: 

SFE = 1-A 

The average outgoing quality may now be defined as: 

ZpFD 

ZFE+ZpFE+ZpFD 


AOQ 


A(sfl){s->-2) 

(8+2-A)(s+n+l)(s+n + 2) + A(s+l)(s+2l 


Considering AOQ as a function of s, it is found that AOQ has a 
maximum value. Thus, we may define average outgoing quality limit 
(AOQL) as: 

AOOL = -^ a<4- ^ 6) 

4n , 2 

In Sq. (l) it was assumed that the tru.e value of A was known. How- 
ever, if sampling was applied, this is not the case. Let "B'‘ denote the 
fraction of lots to which sampling was applied. Tiien from Eq. ( 4 ) it 
follows that : 

BA(s4l)/'(t-p)®+'‘‘dp = bA 

s + n+l 

(where n' = size of sample actually used.) 


is the fraction of partially defective lots which would have been con- 
sidered 1005^ effective lots. Thus if A* is the reported value of A 
then : 


a' 


A-AB 


s + l 
s+n* + l 
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(7) 


Therefore Eq. (6) can be written as: 

- A* * (s+n*-H) 

4(A0QL1 (s+n'+l)-B(s4-l) 

From Eq, (7) when n*, B, A’ and s are known^ n can be detei^ained in 
order to ensure any AOQL. ’! 

OC CURVES 

From Eq, (6), it is evident that if the AOQL is fixed; theii for 
each value of A there is a corresponding n. This relation is shown in 
Table II with AOQL = 0.5^. -I 

In order to avoid screening of lots a second sample of 100 *^n items 
is taken if the first sample contains any defectives. From Eq. k, it 
follows that the probability of accepting a lot with fraction defective 
p on the first sair^le is : 

rP'+AP 

l^=A(s+iy^, (l-p)®‘*‘”dp p':sP<P'+AP' 


If AQL*s of 1.5'^ and 4,0/0 are used (Table III), then the probabil- 
ity of acceptance on the second sample is: 


a Probability of obtaining 
two or less defectives in 
a sample of 100-n (AQL a 

Prn » Probability of obtaining 
six or : less defectives in 
a sample of 100-n (AQL « 
4.0/0) 

^ ' joo-ny, joo-n-k 
P„=Z c, (i-p) P 


^ 5 joo-n,, joo-n-k k 
(i-p) P 


with p = p'+4^p' 


Therefore the probability of 
acceptance on the combined samples 
is : 

Pam=Pa^Pm (AQL* 1.5%) 


(AQL=4.0%) 


TABLE 1 1 j :! ' 

RELATIONSHIP BETWEEN 0^011 VES 

ALLOWED PER 

100 ANO AQL 

DEFECTIVES 

AQL - PRODUCER ' S 

ALLOWED PER 100 

risk 0.05 

• 0 ' 

on% 

1 

0.3 

2 

o:.7 

3 

1.3 

. 4 

2i0 

5 

2 >6 

6 

3.3 

7 

4.0 

8 

ti'.B 

9 

S.5 

10 

6.2 

11 

no 

12 

7';8 

13 

8.6 

14 

9.5 

15 

. 10.3 __ 

COMPUTED FROM 

REFEREKfJE ('3) 


These values are shown In Table II for s, =■ 3, p’^ 0.0, 0.05, 0^10, 0.15, 

0.20, 0.25, 0.30, 0.35, 0.4o, 0.45, 0.50 with ^p' a 0.05. . 


AVERAGE SAMPIB NUMBERS : : , , 

From Eg. 's (3) and (4) it follows that the probability of ijio deci- 
Sion on the first sample is: 

l^psA(s + l)/ ( l-p)®clp-A(s + l) (l-p) dp 
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Hence the average sample number (ASH ) may he defined : 

ASN^^=n I?^+I^dASNm (AQL=L57o) (8) 

(AQL = 4.07o) (9) 

Where ASNJ^ (ASNj^) is the ASW for a sample of 100-n with | (6) de- 
fectives allowed in this sample. 

(k) 

It can he shown that' 


ASN„ = f - Ps-.ioo-n**"- *> ’’a- 


, (n-2)p p 

zjoo-n (j-p) Mtioo-n 


ASN^«= 


1 7(l~p) 
P “ P 


With p»p'+4^p' and Pj^.^ = probability of obtaining exactly k; defec- 
tives in a sample of r. ‘ 

Since all of the quantities in Eq. *s (8) and (9) are known; these 
equations can be solved determining an ASW for each p' andAp^. If 
thsse ASW’s are svraed oyer 0 sp s 1 according to the above divisions 
(Note: The division G. 5 to 1.0 with a corresponding Ap’ ~ O.J is in- 
cluded), then there results an ASN for the entire plan. Tliese ^SW*s are 
shown in Table II. . 

LARGE LOT APPLICATIONS 

The basic theory of Discovery Sampling is independent of the lot 
size. However, it is advantageous to decrease the probability of ac- 
cepting an unusually large lot with a leirge fraction defective and thus 
decrease the possible fluctuation in the ^ 

In order to accomplish this and to maintain the simplicit;^ of the 
sampling plan, it was decided that a Ipt with mpre than lOQp pieces or 
more than twice the usvial number of pieces wouLLd be regar<ied an a large 
lot. The probability of acceptance of such a lot would be deci^eased by 
simply doubling the normal sample size# 

SAMPLE NUMBER CONTROL CHA^ 

If no assignable causes for fluctions of A (Eq. l) are present, 
then values of A may be assumed to be normally distributed. Since n 
bears a linear relationship to A (Eq. 6), values of n may also be as- 
sumed to be normally distributed. 

Control charts for individuals or averages, and ranges can be de- 
veloped with n as the variable. The usual indications of but -qf -control 
conditions or tendencies will signal the presence of assignable causes 
and the need, for an investigation. 
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AtrrOMATIC GAGING OF COMPLEX PARTS BI TAPE CONTROLS > ESQ . 

W. S. Tandler 

The Wamer & Swasey Research Corporation 

There are times in the^^^ M of scientific and industrial ’?levelop- 
ment at i^ich the opinion prevails that a peak of development has;! heeh 
reached and that things will now stay the way they are and for a| long 
time," among a large number of people, there 

are others at work 'sdio for some reason or another prepare new thin^ 
which after a while tend to replace the old ones. This causes a struggle 
during ^*iich certain of the new things win out and certain of the : old 
ones remain. During such a period of struggle one i^ould be cautioiis to 
predict the outcome, but one should keep abreast with the facts* | We live 
in such a period in which the enormous technological achievements: of the 
late 19 th and the eai^ 20th century are now attacked by the new Scien- 
tific discoveries and inventions ^pse origins can be traced backj to 
about the time ^e tecdniology of the 19th cehtuxy and the eao*2y part 
of this centiny was in full blossom* 

The effects of Ifc is struggle ea 5 )ress themselves in many different 
ways in different fields but common underlying trends are clearly' recog- 
nizable. Among those trends, and I believe perhaps the strong st|, is the 
tendency towards application of precise meastirenients and mathematical ex- 
pression. 

Our field, ^automatic gaging of conplex parts,” is but a very minute 
portion of the total picture. Still, in it are active the same trends 
toward increased accuracy and precise mathematical expression. 

Our field, specialized as it may be, is still larger than cotild be 
dealt with with any degree of satisfaction in a short paper and fjt ap- 
pears preferable to concentrate on the smallest complex within this field 
which still has general significance, genera interest, and, I be|.ieve, 
quite general application. 

Wears concerning ourselves here with the gaging, i.e. the dimen- 
sional measureinent of small and medium parts ; things 

like screws, turbine blades, gears, castings, etc. We are not talking 
about microscopic particles, nor are we talking of buildings, bridges, etc. 
Within this group are many parts which require practically no dimensional 
inspection, and others which are of such simplicity that one or two meas- 
urements completely define the part. There naturally have been developed 
methods for the gaging of such parts. Our concern is with those parts 
that have a large number of surfaces and dimensions; some of whic^ may be 
independent of each other, others may be closely correlated by tij^t 
tolerances. The greater the number of dimensions to be gaged, the closer 
the tolerances, and the more complex the relationship between dimjaasions 
(cuirved, angular, etc.), the more difficult of course becomes the' gaging 
problem. There is Hardly aiiy part that could not be measured tbciey^ w^^ 
conventional techniques ai5d whose dimensions coulcln*t be re<5ordecl|, inter- 
preted and understood. However, those working in the field have found 
out that, while the above statement is undoubtedly true, the practical 
difficulties, and perhfi^s still more important, the time and cost involv- 
ed, may make the measuring operation which is theoretically possijble, for 
practical reasons a near impossibility. 

The question would remain a theoretical one if it weren't that modem 
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machinery contains numerous parts i^hich are of extreme complexity and de- 
signed to the closest tolerances that our highly developed machining in- 
dustry is capable of maintaining* A hundred or a thousand measurements 
on one part are not unusual, and it is kngm that even ten measurements 
of great accuracy and con5)lex relations msy cause severe problems of in- 
strumentation, measuring operation and interpretation of the measuring 
results. These requirements and the necessity of having to gage complex 
parts economically and at a fairly rapid rate, has led to the development 
of a number of high-precision measuring techniques which are at least 
capable of handling the accuracy problem and which operate at a reason- 
ably high rate. However, it was found out that the obtaining of measure- 
ments, even thou^ at a rapid rate, still leaves something important to 
be desired, and that is the interpretation and the evaluation of the meas- 
uring results. 

In a congjlex (multi-dimensional) part the individual measurement may 
be of little significance. It is the correlation of all measurements 
which determines acceptability of a part . It is therefore necessary to 
correlate numerous individual measurements and come lap with a total 
answer. This answer is often not just a matter of addition and subtrac- 
tion but may entail higher orders of coB5)utation, The difficulty of such 
con5)utation, combined with the error possibilities and probabilities both 
in the part and in the measuring instrument and technique, have often led 
to a situation in lAiich it is impossible to arrive at a definitive con- 
clusion. The complexity and the resulting confusion is sometimes such 
that there is either no meeting of the mind or repeated measurements and 
interpretations vary so much from each other that it is iirpossible to say 
what a true statement would have to be« This is by no means an isolated 
case; it is a serious problem* 

I believe it is in this region in ^rfiich the conventional or tradi- 
tional technique has found its limitation and where the struggle for 
application of new principles seems to favor most decidedly the new tech- 
niques . 

In essence, the new technique must be capable of correlating measur- 
ing results, computing them, and coming up with a unique answer* 

There are two approaches possible: One is what may be called the 
graphic technique; the other one, automatic computation which in turn may 
result in numerical presentation or in automatic assorting or segregation* 

By graphic technique is meant an approach by which the measuring re- 
sxilts are presented not as a hodgepodge of individual measuring data - 
be it in form of a table or otherwise - but in the form of a graph or 
chart which is laid out and designed in such a way that a human operator 
is capable of interpreting and drawing conclusions from the stu^ of such 
a grai^, and can do this within a reasonable tijne* Gaging machines of 
this type have been on the market for approximately twenty years and the 
trend towards graphic presentation is increasing* It permits the oper- 
ator to see at one glance what wuld take sometimes an hour of painstak- 
ing computation to evaluate* 

Automatic computing of measuring restilts, in its simplest form, is 
the "go - no go" gage. Gages of Ihis type have been known for a long 
time, as applied to individual dimensions. But the technique of combin- 
ing several measurements in one single computing operation is new* 
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We employ in our irartc products both techniques, the chart 

or ^aphic presentation and the autoina*^}.c coB^utatton. 

Needless to say that a chart can be drara up from individual,; measure- 
ments by hand and a calculating or computing machine can be used -to eval- 
uate a group of individual measurements * Such a procedure is of covirse 
old, but the incorporation of the recor<^ng system into an autom|t^ 
operating measuring machine and the incorporation of a computing ’system 
into an automatic inspection machine, are of recent origin. 

We produce a machine, the Automatic AIRfOIL PROBOGfUPH, idiich com- 
bines both techniques. It first measures automtipally^ computes the re- 
sults, and decides 'whether to accept or reject in accordance jd set 
tolerances incorporated into the machine. If the decision is to |accept, 
no further action is taken. However, if the decision is to reject, the 
Automatic AIRFOIL PROBpGRAPH, automatically and on its own, records all 
measurements in the form of a deviation chart so that this chart ..can 
serve as a rejection report without requifthg 

It would not have been possible to build such au-tom^^^^^ 
machinery without applying new measuring techniques as such, I developed 
over a number of years a technique, known as the PEOBOGRAPH methpd, in 
which measurements are ta^n by electric contact (not by spark) and cor- 
related by precision slides, linear -rectangular or rotaiy-polar. ; This 
technique is not only free of the age-old problem of pressure distortion, 
but it l^ds itself to operation — in fact, it Is an 

technique. It did not originate by iatproHng a hand-operated melhodj it 
was conceived and designed for automatic operation. It is therejfore com- 
pletely under automatic control. In some instances this control ds se- 
quence control, in others program and tape control, ' 

In order to establii^, introduce and successfully start the PROBO- 
GRAPH technique, a basic concept of part -design had to go along Mth it. 
This concept is coordinate dimo^ stoning. In the early days of the 
PROBOQRAPH the possibility of coor<Enate dimerisipning of drawings was 

considered worse 

Today coordinate dimensioning is a strong factor, ihdu^ not yet' univers- 
ally applied. Coordinate dimensioning is not only a basic requirement of 
automatic measurejre^^^^^^^^ complex parts; it is a basic requirement of auto- 
matic computation. jSe I^IOBOGEAPH measuring techniqu and the automatic 
computor go hand in hand. The cpnputor furnishes data for the j^OBOGRATH 
to measure, and the (teta of the HlpBOGRAi^, can be processed thrdhgh a com- 
putor, Naturally, the use of an intricate large-size computor is only re- 
quired in exceptional cases. Most of present-day Inspection technique 
revolves arpund parts which are simple enough to be handled without 
tensive computing, but which are by far too complex to be handled without 
a sinple and rapid computing mechanism incorporated into the st^dard 
PROBOGRAPH models . The extent of cpaputation requires depends on the 
application, but the underlying idea of digital couputor and of "PROBO- 
GRAPH coordinate automatic measuring technique is the same. 

This idea, as initially remarked, consists basically of thp two 
elements; higher accuracy, and Increased use of mal^ematiCi^ thinking, 

Ify own field is of course the ^plication of the PROBOGRAPH’ technique 
to the numerous measuring problems which are brought to us or vtitch we 
attempt to discover and point out. Some of these problems are pf a 
nature in which thousands pf sii^lar parts are processed, and iti this 
case not only is speed of the essence, but it is also possible to invest 
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in a fairly elaborate setup ^ich is called ’’Tooling” and which permits 
to ta^e as many as desired, but usually UO - 50 measurements simultan- 
eously and to come up with an answer within a matter of seconds, and a 
recorded chart if the answer is rejection. These measuring madiines are 
called multi -probe PROBOGRAPHS. 

There is, however, an increasing number of measuring problems in 
which only relatively small quantities or even single parts have to be 
Inspected and where our technique as such, because of its element of 
pressurelessness and automatic operation, is of great advantage but where 
a setup or tooling is for economical reasons or time limitations not 
practical. Therefore, instead of relying on tooling and taking all meas- 
urements siirmltaneously, we have developed the single-probe PROBOGRAPH 
in ^ich one (occasionally two or more) probe performs all the measuring 
operations consecutively instead of simultaneously. 

The measuring operations have to be programmed. We have built such 
programmed measuring machines for many years, and in more recent years 
these machines were delivered and are being operated with punched tape 
controls. The punched tape (preferably 8-hole Flexowriter) furnishes the 
machine not only with the program of its operation, but also with the 
digital numerical data required. These data fall into two groups: (l) 
The positioning data, the points at which the measurements are taken; and 
(2) the measuring data, i.e. the dimensions which the instrument should 
read at a given position. The PROBOGRAPH, besides automatically position- 
ing, also operates with the nominal dimensions of the part and in its 
operation automatically compares the nominal with the actual dimensions. 
The difference between nominal and actual dimension is of course the 
’’error.” Dependent on the machine, this ’’error” is recorded or used for 
computation, or both. 

The techniques of automatically controlling the positioning as well 
as the indication of nominal dimensions were developed over many years, 
and as the requirements for more and more con^lex parts increased, and 
as the number of necessary measuremaits became larger and larger, we in- 
troduced tape control to an increasing degree, because tape is one of the 
best means of storing large amounts of data in digital form for the oper- 
ation of automatic machines. It seems needless to point out that in 
order to do the required job our system including tape controls had to be 
not only automatic but also practically unlimited in accuracy as well as 
definition, that it further had to be absolutely reliable and neither 
limited in distance of travel nor in operating speed. Our system incoxp- 
orated in the PROBOGRAPH, PROBOMAT, TEI^-HIOBOMAT and PILOT PRCBOMAT ful- 
fills all these specifications. With such a mettiod it is therefore pos- 
sible to handle measuring problems of the most complex kind, not only by 
elaborate tooling, but on a single-piece basis by tape controls. 

This development of a fully-automatic tape control positioning and 
measuring system led to a most significant consequence. 

The same controls 1hat are applicable to positioning for measuring 
are also applicable to machine tool controls in general. We are actually 
operating with the same system not only our measuring machines, but also 
jig borers. This fact is of major significance because it proves that 
the same basic principles of coordinate dimensioning apply both to the 
making and to the inspection, and if properly applied, can be handled by 
tape control. 
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A tape prepared for the automatic control of ji jig borer, for in- 
stance, can be converted into anpiiier tape for use of an automatip meae- 
uring machine. The two tapes contain the same basic inf ormati^^ 
command and digital type. There are only minor differences due tp the 
nature of the machine process and the measuring process. The conyersion 
from one tape to the other requires only a fixed set of rules andj not 
the thinking and decision of a human operator. Consequently, a pikrt can 
be produced, for instance on a jig borer, under full tape control'. The 
tape used can be converted for inspection purposes and this new tjape 
serves to inspect the part. It is of course understood that the jbape 
must be of such a nature that it CM^ properly verified, both for manu- 
facture and for in^ection^ What is true for the jig borer is aliso true 
for practically any other machine tool. The inspection machine heed not 
incorporate the majority of functions of the machi^^ only must 

have the saine coordinate^ system built into it in the fpi^ of sli4^^ 

rotary devices. That means, that one universal inspection machine with a 
proper coordinate system in a sufficient niunber of degrees of freedom, can 
be used to check and inspect an almost infinite variety of products. In 
practical application the following considerations and possibilities are 
of interest; 

1, The measuring machine, though having the same coordinate system 
as the machine tool, has none of the following problems: no high speed, 
no tool pressure, no coolants, no diips, no heat generated in tha machin- 
ing process. Therefore, althou^ the control tape may be essentially the 
same, the measuring machine shows the purified results and indicates tfee 
deviations caused by the elements enumerated above. In this manner the 

nature of these elements can be asce^^taiM incorporated into: the 

machine tool tape in the form of correction factors, if and whera needed. 

2, In certain industries, mostly of a military kind, subcontracting 
is not only economically advantageoiis but strategically necessai^r for 
dispersion. In this case it is possible to establish a relationship bet- 
ween subcontractor using tape for manufacture, and manufacturer using the 
tape to ascertain that the part delivered corresponds to the specifica- 
tions without the need of discussions, interpretations and all the ensu- 
ing mis\inderstandings and conflicts, 

3, Experiaice has shown that the introduction of a rational method 
based on coordinates ^d aut^ controls demands a precision qf think- 
ing and specifications which, while sometimes not easy to obtain, have 
always proven to be of a veiy healthy influence and have solved many a 
knotty problem. 

One purpose of this paper appeared to me to acquaint you wi|b the. 
origin and the basic problems and implications of automatic gaging of com- 
plex parts and how its principles tie in with other fields. We $ ^ 
made a start, and the biggest results are yet to come. A few illust ra- 
tions here-attached may help in visualizing the practical applic|ti<»is , 

The nui^er and variety of "con^jlex parts” is such that an enumeration 
of a few of them is all that we can attempt to give here. They form es- 
sentially two categories: (1) contoured parts, and (2) non-contoured 
parts. Among the contoured parts idiich are of inport ance are caito, gears, 
airfoil and waterfoil shapes such as turbine blades, propellers, etc. 

Most of these parts have also non-contoured surfaces, flats, cylindrical 
forms, and holes. 
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Among the non-contoured "complex’^ parts are housings, such as gear 
housings, turbine, con 5 )ressor and pump housings, shafts, and an endless 
variety of other parts. The close control and inspection of concentric- 
ity and alignment of bores, spacing of holes and their relation to other 
surfaces on the same piece appears to be one of the most exacting jobs 
at the present moment. 

The control of manufacture and inspection of the second category 
(the non-contour ed parts) is at least as great a field as that of the 
first categoiy (contoured parts). However, contoured parts having sud- 
denly grown into prominence with the advent of gas turbines and high- 
precision cams, as well as coii 5 >lex gearing, industry was less prepared 
to cope with these problems and therefore the new techniques such as the 
PROBOGl^HJ found an open door. Therefore, the initial progress of auto- 
matic ini^ection methods of complex parts including tape-controlled meas- 
uring machines was made in the field of contoured parts. Our illustra- 
tions show a number of these machines. Actually it has become evident 
today that these same methods that were developed for complex contoured 
parts can be applied most profitably to non-contoured parts, both in auto- 
matic tape-controlled manufacture and in automatic inspection. 
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Fig . 1 

Illustration 1 shows a FROBOMAT tape-controlled automatic inspection 
machine in operation. To the left of the operator is the measuring unit. 
The part under inspection is an inqjeller idieel sot up for the measurement 
of the CTirvature of its vanes. To the right is the control unit ^diioh in- 
cludes both the tape controls and the recording unit. Measuring and con- 
trol units are connected by electric cable. 
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Fig* 2 

Illustration 2 shows a close-up of the impeller wheel being ®i®^9Tired 
on the PROBOMAT and the relative position of the probe holder to ;;the yanes 
of an iupeller wheel. The probe holder is mounted pn an arm „idii<^ extends 
from the measuriiog head. The probe holder is moyed by program control to 
the positions and ^ points indicated by the print. The ^eel is 

held in a rotary fixture. 

Illustratipn 3 is a det ailed view of showing the [adjust- 

able probe holder; the arrangement of the probe points in f orm o| a “T”. 
The right-hand probe is measuring a portion of an^ i^ 

Illustratipn U is a close-up of the control unit of the PROl^MAT 
showing the record chart atd also the tape reader and the punched tape 
whidh controls the madiine. The recording is made on a strip chdrt. This 
chart is advanced by a small step for eadi measurement. The mea^rement 
is carried out by the stylus cluster traveling across the chart •' For 
each measurement tbe mphim^ a nominaj black d^ts ar- 

ranged in a straight line) and an actual mark. The distance between the 
nominal and the actual m^k shows the error. In this particular instal- 
lation each line on the chart is equivalent to .0001” . In some ji)f our 
machines each dot is numbered by an automatic staB 5 )ing mechanism | In 
others, this is not f otmd necessary. 
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Fig- i 

Illustration $ shows a front-view of AUTOMATIC AIRFOIL PROROGRAPH 
MP-15 which is used primarily for the inspection of large quantities of 
turbine blades, con^jressor blades, etc. AIRFOIL ffiOBOGRAPH MP-|^ is an 
automatic machine. Measurements are taken at UO or $0 points simultan- 
eously. The measuring results are automatically confuted and a green 
light signifies acceptance, a red light rejection. The machine ’(contains 
tolerance units which .are adjustable to specified tolerance requirements. 
If all measurements of a blade are wi'ttiin the set tolerahoes, tlie matiiihe 
accepts the blade by showing a green li^t. If any deviation is' outside 
tolerance, the machine rejects the blade by showing a red li^t^' In this 
case it automatically repeats its measurement and records all measuring 
deviations on the strip chart. No record is made of good blades;, however 
the machine can be set to record all or any blade, if desired. ’(The strip 
chart roll is stored bn the chait exf^ds under the |tylus 

unit, comes down the slanted portioin and stretches over the Tdio|e length 
of the machine to permit clesr aid easy observation. The probe (banks 
mount the forty probe holders which are set by plJi masters to the precise 
nominal contour of the blade. The blade is held in the holding “fixture 
visible between the probe banks. 

Illustration 6 shows a close-vq> of the AIRFOIL PROBOGRAPH MP-15. 
Strip chart and styli ban be seen in the foreground. A number of blades 
are spread out. The probe banks and holding fixture are visible tow^ 
the center right. In operation the operator presses a start buttonj the 
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probe banks approach, first fast, then slow; the probes make contact and 
take readings of the blade which are recorded by the styli moving over 
the recordii^ paper at a magnified ratio (UO:!, 80:1, etc.)* 

Illustrittion 7 shows a blade holding fixture for AIRFOIL PROBOGRAPH 
MP-I 5 . These fixtures are designed and made for mass inspection to facil- 
itate precise holding and quick loading and unloading. A compressor 
blade is Ih the fixture. 



Illustration 8: The measurements are carried put by probes ■ mounted 
In banks. This illustration Shows a set of probe banks for AXRFQIL 
FROBOGRAPH MP-lJ. These probe banks are standard accessories. Tfee probes 
are held in holders which are platforms, and these ini: t\n*n are 

mounted on the probe bank stands. Ihe probes are wired into a c^le with 
a multiple prong plug. To set up a probe bank is largely a job of as- 
sembling standard parts. Probe bank components can be used overt 

Illustration 9 shows a set of PROBOGRAPH pin masters. Pin ^masters 
are used to set up (master) imilti -probe machines. The probing pbints are 
represented by adjustable pins. The tips of these pins are ground to the 
proper contour angle. Pin masters have proven extremely useful.. Master 
blades, of course, could be used to set up a PRCBOGRAPH, but marter 
blades are often not perfect and too eaqpensive. They are not adjustable. 
On the pin master, not only the offset dimaision but also the ekact sta- 
tion dimensions are fix This is very iirportant in interpretation and 
automatic assorting. 
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Fig. 2 

We described above in an abbreviated form the development, the tmder- 
lying fundamentals and various factors governing automatic gaging of com- 
plex parts. We also showed in more detail two examples of existing auto- 
matic inspection equipment, one for small production or even single ap- 
plications, the other for mass production. We further discussed the close 
relation of tape-controlled gaging technique with tape-controlled produc- 
tion technique by means of the single-probe type PROBOGRAPH or PROBOMAT as 
applied to small production. It is interesting to observe that no such 
close connection exists between mass production on the one hand, and mass 
inspection by multi-probe technique on the other hand. 

This brings up a fundamental difference between small production 
methods and mass production methods. When speaking of small and mass pro- 
duction we realize that the borderline is not easily drawn. However, there 
is one basic difference: small production means frequent changes and flex- 
ibility of equipment; large production means practically no changes, and 
durability and efficiency of equipment. Tape control is one of the great- 
est steps forward in attaining automatic equipment which at the same time 
is flexible. The equivalent part in mass production is played by transfer 
machinery. As mentioned before, the inspection problem of t^e-controlled 
machine production can be solved by tape-controlled gaging. The inspec- 
tion problem of mass production can be solved by the use of tooled auto- 
matic computing and recording gaging madiines. It will be noted that the 
gaging methods described here are all applied to the part after it leaves 
the production machine. No in-process gaging was described. The reason 
for this lies in the fact that we are dealing here with con^lex parts only 
for Ti^ich inspection in process with feedback correction is not likely to 
be practical in the near future. On the other hand, automation of gaging 
of coTBplex parts is a necessity in order to keep pace with automatic pro- 
duction methods. It looked for a idiile as thou^ automation of production 
would coirpletely outdistance automation of inspection. We believe we are 
on the road not only to hold our own but perhsgjs even to gain the lead. 
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coi^swm-suFFum quality 

John L. King 
Ford Motor Company 

The Automotive Division, American Society of Quality Control has a 
group of ten Task Force Sub-Cojpdtttfs^^r^^^ the use of scientific 

methods of Quality Control in various phases of the Autoraative Industry, 
One sub- committee > of vhich I am the chairman, is investigating consumer- 
supplier quality problems and relations, ;■ 

The stated goals of this task force group are; 

1. An Automotive Industry survey to ascertain: ;! 

a, Vhat the major automotive suppliers consider the 
paramount criticisms of the consumers in quality 
matters. 

b, Vhat the autcmiptiye companies consider the paramount .: 

criticisms of the suppliers in quality meitters, 

c, What the consumers and suppliers consider the most ;■ 

•workable relations they have developed with individual 
firms, citing the significant things about such relaiions 
that cause them to stand out as dif;?erent. -j 

2, Industry standardization, if practical, on; 

a. Sampling plans. 

b. Nomenclature. 

c. Acceptable quality levels. 

3* Possibility of the consumer publishing his inspection method 

to his supplier at the time of bid, or thereafter, including; 

a. Sampling plan. 

b. Characteristics covered by the sampling plan, 

. c. Classification of.. .the. ,,cteracteristic.§.,. 

d. Acceptable quality level for each characteristic, 

4. Standardization, if practical, of "Initial Samples” and ^'First 

Production Shipment” inspection and acceptance practices;i 

5. Formalized and standardized inspection and quality agreements, 

certification agreements, etc. 

As you can see, the group has outlined some smbitious goals %o be 
achieved and, as you may suspect, these goals have not (at the time of 
the -writing of this paper - 3/^/5?) all been achieved. Significa|it 
steps toward these , goals have been made however, so I would like fe 
present to you what in effect is a progress report of the achievements 
to date. 

T-wo questionnaires have been prepared and dispersed. One Wab 
directed to a random sample of automotive parts suppliers and the'; other 
to a random sample of receiving locations in automotive plants, 1^^ 
returns from the later have not as yet been received as the ques-fcion- 
naires have only recently been mailed. A good response from the parts 
suppliers have been received, however. 
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Questionnaires were mailed to six hundred parts suppliers. To date, 
132 have responded and responses are still trickling in. 

It was encouraging to the committee to discover that 9k percent of 
the responses indicated that the committee's goals were thought to he 
worthwhile and that our committee was the proper organization to he work- 
ing toward them. Of course we do not know what opinions the 450 plus 
suppliers that did not answer the questionnaire have. Mayhe 9^ percent 
of them think the opposite. This is prohahly not the case, however, for 
if it were they undoubtedly would have returned the questionnaire with 
that indication. 

You may he interested in knowing the size of the companies that 
responded, which is presuraahly also the size of those contacted, ^k 
percent had fewer than 200 employees, 59 percent had from 200 to 7OO, 

16 percent had 700 to 2,000, 9 percent had 2,000 to 5^000 and only 2 
percent had over 5^000. 

The suppliers were asked if they employed a group of people whose 
primary function was to control the quality of parts produced hy others. 
78 percent answered yes and 21 percent answered no. Of those answering 
no, the majority (67 percent), as might he expected, were in the smallest 
size catagory, (200 or fewer employees). 26 percent were in the 200 to 
700 catagory and only 7 percent above 700* The lack of quality control 
personnel being in the smaller shops would he expected because management 
is in closer contact with the workers and the esprit de corps is apt to 
he more prevalent than in the larger more impersonal plants, 

A scatter diagram of the size versus ratio of quality control people 
to production people indicated some positive correlation (the larger the 
company the larger the ratio) , This correlation \7as slight, however, and 
even some of the largest companies had ratios of 1 to 75 or less. And 
some of the smallest had ratios as large as 1 to 6. 

There was a good correlation, however, between the ratio of quality- 
control people and the type of product produced. As one would expect, 
the precision parts manufacturers had significantly higher ratios than 
did manufacturers of less precise parts. 

The percentage of responses indicating that Statistical Quality 
Control was employed as a management tool was about evenly split (52 per- 
cent yeses and 48 percent noes). This is quite encouraging except that 
one again tends to wonder about those shops that did not respond. Maybe 
the reason they didn't was because they did not haVe a quality control 
analyst to -which to give the Job of filling out the questionnaire, or 
maybe they were so busy struggling idth less effective control methods 
that they didn't have time to respond. Of the answers from plants that 
manufacture predominantly precision parts, however, over two- thirds 
indicated that Statistical Quality Control was used. 

Of the suppliers that responded, kk percent indicated that from 20 
to 50 percent of their total production goes to the Auto Industry, I6 
percent indicated that less than 20 percent, and 40 percent indicated 
that more than half of their production goes to the Auto Industry. All 
but one percent have two or more customers in the Industry. 
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Regarding the cause of quaJLity problems in the suppliers plants^ it 
seems that the biggest contributing factor is the tendency for machine 
operators and/or their supervisors toward a relaxing of quality cjbnscious- 
ness. This indicates that frequent or continuous quality campaigns are 
necessary to maintain satisfactory quality. However, incapability of 
machines is sometimes the cause for quality problems as is the hbicidetec-* 
tion of poor quality parts when they are produced. 

In reviewing answers to questions that dealt with the suppliers 
relations with his customers, it .was discovered that inconsistent/ 
customer practices and lack of information regarding what is expected of 
them in the way of quality seemed to be the major areas causing itrained 
relations . 

Thirty seven percent indicated their customers were Inconsistent in 
their receiving inspection practices while 22 percent indicated they did 
not know if their customers ^re consistent or not. Over half ij^dicated 
inconsistency between customers while 65 percent felt that it would be 
desirable to have consistency between them. I 

It was interesting to discover that 84 percent indicated th^y 
believed their customers quality specifications were ^'generally’* _ 
reasonable, 3 percent believed them "always" reasonable and the r^J^oainlng 

13 percent indicated them "sometimes" reasonable. 

When asked the question -vdiether they had sufficient information 
regarding vhat their customers expected of them in the way of qu|iity, 
only l4 percent answered "always," TO percent answered "generally" and 

14 percent answered "sometimes." Another way of stating this is "that 

86 percent indicated that they do not always have sufficient information 
regarding what is expected of them. This percentage is quite high and 
it appears this is one of the major areas where improvement is hleded. 

The suppliers would also like this area improved for 91 perdent 
indicated they would like their customers to publish their inspection 
method including the amount of inspection and the ranking of relative 
importance of dimensions at the time bids are askod for pr thereafter. 
Several crossed out "or thereafter" indicating they would definitely like 
to see it done at the time bids are asked for. 

We received the indication that most of the time the su^^ 
sufficient opportunity to discuss their quality problems with thCir 
customers and when discussed they usually arrive at reasonable under- 
standings. It would naturally be desirable for them to always have 
sufficient opportunities to discuss their problems with their cu|tomers 
when they have problems. It would be even more desirable, ho’^revbr, for 
both parties if they did not have any problems. 

The committee attempted to determine how the suppliers feel/regard- 
ing Quality Certification Agreements. In the first place there "^re 29 
percent that had entered into such agreements with their customers. Of 
the ones that were parties to the agreements, only three -fourths" felt 
that they were of definite benefit to them. Approximately one- fourth 
felt that they had been pressured into making the agreements because 
they would primarily benefit their customer. Of those not having certi- 
fication agreements, about half (46 percent) believed that such agree- 
ments. could be beneficial to them and about two-thl^ds (62 percent) felt 
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that such agreements could he heneficial to . their customers. It appears 
that Certification is a field that can stand improvement and esqpansion 
and may -well hear further investigation hy hoth supplier and consiamer. 

It seems that the Automotive Industries* practices relating to 
inspection and acceptance of '* Initial Samples" and "First Production 
Shipments" do not present any major problems to the Suppliers although 
there is a slight problem there. 17 percent indicated that existing 
practices vere unsatisfactory and that it would he heneficial if an 
industry wide standardization of such practices were affected. 

Fifty four percent of those answering indicated that their customer 
relations were getting better, 57 percent indicated no change and 9 per- 
cent indicated their relations were getting worse. The Committee tried 
to discover if there were any answers given hy the 9 percent that were 
significantly different from the remainder. Actually, there were not 
enough in the catagory of "getting worse" to give any significant answers, 
Tliere did seem to he a tendency toward real differences in some answers 
to some of the questions, however, and if our sample had been larger we 
may have discovered significance in the following. It seemed that a 
larger percentage of their total production goes to the Auto Industry, 
they feel they have less opportunity to discuss their qusLlity problems 
with their customers and that they are less apt to arrive at reasonable 
understandings when they do discuss them, their quality problems are 
more often caused by a general relaxing of quality consciousness on the 
part of machine operators and/or their supervisors, and lastly they feel 
their customers are less consistent in their receiving inspection 
practices. In analyzing the written comments (all but one contributed 
additional comments to the questionnaire, the over-all average was one 
out of four,), it seemed that the major cause for the deteriorating trend 
in their customer relations was that they felt the quality requirements 
were continually increasing and that their customers were not willing to 
pay for the resulting added costs. 

In summarizing the answers -to the specific questions and drawing 
conclusions to the written comments, the committee feels the following 
statements are true. In general: 

1, Suppliers do not have enough infomation about ^at is 
expected of them in the way of quality. 

2. A small percentage of the specifications are considered 
unreasonable , 

5, There is room for expansion for Statistical Quality Control. 

4. Machines are more capable than men in the job of producing 
quality parts, 

5. There are inconsistent practices in and between receiving 
inspection areas and it would be advantageous if these were 
eliminated. 

6. There is room for improvement and expansion in Quality Level 
Certification practices. 

7* "Initial Samples" and "First Production Shipment" inspection 
and acceptance practices are fair but can stand some improve- 
ment and standardization, 

8. The customers are becoming more and more demanding. 

Competition is becoming keener. Quality requirements are 
steadily increasing. 
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• And lastly, the key to good customer relations definitely 
seems to be good communications. It seems that if the! 
Suppliers maintain close, contact 

Engineering and Quality Control personnel he generally 
avoids having trouble or if he does have any, he soon ' 
gets out of it. 

In conclusion, the Sub- Committee considering consumer- supplier 
quality problems and relations plans to do further analysis of !the 
results of this questionnaire and the results of the questionnaire sent 
to the auto manufacturers (\«hen adequate results 8U*e received). We p]-an 
to have additional information regarding these questionnaires aijad the 
Committee’s recommen^tions available for presentation at the Q^lity 
Control Convention iul^ May 22-2k, 1957* 
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HEPOmNG Am) ANAI^IJIG PROl^ 

IN A SWEDISH STEEL PUNT, 

C, Jan Yngstrom 
Donmarfvet Iron & Steel Works, 

In pr(ier^t^ a rationalized production and a stabilized’ quality 
statistical methods and statistical thinking have proved to be Useful 
tools. It has been possible to use methods worked out by theorists. In 
applying the theories in practice the U.S,A. have been pioneers ;|and the 
A,S,Q,C, have been active contributors. It is a great pleasure to state 
the fact that the American results have been widely published and they 
have been leading the development. The intention here is now t 9 show in 
what ways we have been preceding in a Swedish steel plant to stimuiate 
statistical thinking. 

The examples here are taken from the Domnarfvet Ixpn & Steel Works, 
owned by the Stora Kopparberg Company, Sweden, The production 1956 vas 
550,000 tons of ingots produced in four basic Be s seiner converters, a 
kaldofumace and five elect ro- furnace s. All of them are charged ^th 
heats of about only 30 tons. The number of heats was therefor^ *;compara-» 
tively great, totalling some 22,000, The products are hot rolled plate, 
rails and beams, sections, rods and strips. 

A steel plant is - as we all know - a continuous chain of produc- 
tion and the variations must be analysed in each section. Each depart- 
ment must work on whatever the previous department hands down. That 
means that the flow must be canalized and easily analysed. 

Analysis Analysis' 

of variation of flow 

Sintering plant < 

Blast furnaces 

Steel dept, ; furnaces 

pouring pits 

Bloom and billet mills 

Finishing rolling mills 

The Human Factor 

It has been found that most mistakes are made owing to insufficient 
instructions or to people being out of balance. It happened in the 
sinter plant that the additions of limestone were npt all right. The ad- 
ditions are made by four particular men called mixers, one on edch turn. 
The variations occurred specially on the ni^t turn. The resull^ for two 
months is shown in the following table. 


Men in charge 

No, of observe - 
ations 

Mean deviation 
from lime ratio 
wanted 

Mixer No. 1 

54 

+ 

67 

0.08 

a 

88 

l6 

0,07 

3 

74 

39 

0.07 

4 

82 

29 

0.11 
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Mixer 1 had been operating quite veil. Mixers 2-4 had been opera- 
ting too cautiously and they were given new instructions. Moreover, 
Mixer 4 had too big a mean deviation, as compared with the three others* 
He happened to be an elderly man, vho had just had some kind of break- 
down and he was at that time not fit for the night turn. 

The example shows how the human factor can influence production. 

It is therefore necessary that the reports all over the plant clearly 
show who is responsible for the different operations. 

Technical Relations can be Overshadowed 

A technical process is very often disturbed by secondary factors. 
These factors can be of such a magnitude that it is impossible to get a 
clear view of the technical relations. An example is shown in figures 
1, and 2, and it is taken from the blast furnaces. The intention was to 
see if there was any relation between the manganese and sulphur content 
in the pig iron produced. Figure 1, contains all observations from a 
certain period. The figure is a bit confusing. Figure 2 shows only t'he 
values representing 24 hours without any special delay and with silicon 
and basicity on normal level. 
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Figure 2, 

In this case only two factors were studied. Normally, theije are 
several factors such as consumption of raw inaterial and fuel. |t seems 
advisable not to use all figures available but Just the observations 
where known disturbances have been eliminated. If one wants to ' study the 
influence of disturbances or delays on total production, this wtll have 
to be done separately. 

Reporting Routines 

When the production is uniform, as it is in the sinter plant and in 
the blast furnaces, the reporting routines can be quite simple.-; But when 
production is split up in various grades and products, the reporting is 
a bit more complicated. All figures wanted can, of course, be extracted 
manxially. Since the advent of the punch-card system the figures are more 
easily made available for both reporting and analyzing. 


Cost 

accounting 

It is noticeable that the system described here was developed and 
put into operation in Wheeling Steel Co. by Frank G. Norris almost at the 
same time as in Domnarfvet. - Ihls system has proved to be very 'good in 
following up flow- channels, as a controlling instrument as well'' as for 
studying technical relations . 

Complicated Reports are not wanted 

If the reports are too complicated, they very soon become Inat- 
tractive, and will not be studied with sufficient interest* Fii^re 3. 


Production 

reporting 


Plant-report 

i 

Punch- card 

r 

Production 

analysis 
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shows a very simple example of a report from the Plate Mill, where 
cracks, scabs ajid other defects are indicated. One copy goes straight 
to the metallurgical section and the other goes to the inspection depart- 
ment. 


DOMNARFVeT 
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Aagft cracks 


Side cracks 
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Bumf Ingots 


Figure 3 













Figure k shows the yield in one of the rolling mills and ^t gives a 
true pictuxe of the influence of the defects oh the yield. It also shows 
the yield-level for defectless material. 
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Figure 4 . 
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Centralized or Decentralized Report: 


Previously, there was a trend to centralize the assembling of the 
plant reports, the idea being to reduce hands, but, owing to the im- 
possibility of keeping sufficient contact with the plant -personnel, the 
control proved to be inadequate and a considerable delay in completing 
the reports was observed. 

Centn^Kt prmktdicn reportmg* 



Figure 5. 


e development has definitely gone towax*ds a decentralized system 
6.) The reports are made by the different department offices - 
erintendents being reponsible for them. The reports passing 
srds are also put together by the department. 

Dec&iAofiKt/ pnt^ton reporting. 































In or^r tp get a similar reporting system all over the plant it is 
necessary to co-ordinate the diffe^nt iputines fpr_vhich t^^^ 
statistics is. responsible* All new routines or deviations from o|.d ones 
haye to be checked to fit into the whole system* ' 

Reporting to Ifenagement 

The Management must be kept informed about the actual situation. 

For each unit, operating time and delays are reported graphically* The 
production reached is put in relation to the scheduled output, 
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These reports are made for every 24 hours and the sheet includes a 
week’s result. They are very simple but have none the less proved to be 
of great help to the Management. The weekly and monthly reports are tra- 
ditionalj and, unfortunately, they tend to become much too extensive, but 
efforts are being made to reduce their number as much as possible. 

Technical Statistics 

What, in the pleuat, should be subject to special studies, and who 
shall do it? The General Superintendent has to decide what is the most 
iirgent problem, and the study should be made in close contact with the 
superintendents involved. A small department called Technical Statistics 
has been set up. 

An interesting problem which we have given a lot of thought is the 
relation between the chemical analyses of steel and the physical proi>er- 
ties of the finished product. Earlier practice has been based on a car- 
bon value arrived at through theoretical and en^irical investigations. 

It has been: 

Cv = [.1 + 0.5 (C-0.20)J . C + 0.15 Si + [0.125 + 0.25 (C-0.20}] Ma 

+ 1.25 P and the carbon value gives the physical strength according 
to the formula: 


o-g = ki + k2 . Cy 

where ki and k 2 based on the values from the plant, and they de- 
pend upon the dimensions of the finished product etc. 

Instead of starting from the theoi^etical carbon value the multiple 
correlation between 0*3 and the analyses for C, Si, Mi and P has been 
calculated. The same thing has been described in Industrial Quality Con- 
trol No. 4, 1956^ by J.F. Occasione, and it is interesting to see how 
similar the problem has been. For 8 mms concrete reinforcement bars and 
with the following mean of the analyses 

C « 0.26 Si = 0.27 Ml = 0.92 P = 0.45 
the equation was: 


a-Q = 18.20 + 50.67 C + 9.04 Si + 6.84 Mn + 54.7 P 

or, genemlly written: 

CTg = + kgC + k^ Si + ki^Ma + k^P 

If this equation is transformed to make a comparison with the formula 
earlier used, we arrive at the following: 

Cv = 1-09 C + 0.19 Si + 0.19 Mn + I.I8 P 

and the Cy. for this grade is according to the earlier formula: 

Cv = 1*03 C + 0.15 Si + 0.14 Ml + 1.25 P 
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The con!j>arison shows that the earlier foira^ quite all right. 

The new valu.es gives the situation for the produced steel and the roll- 
ing mill facilities at that time. 

The next question was if the constants for C, Si, Wh and P (kg + 

+ k^ + k^) would change, if the rounds were not 8 mms but l6 or; 25 rams. 
They proved to be about the same, except the first constant factorV ^hich 
changed. For I6 nps it was 12.0 and^ f^^^ mms 9.7. The factors , 

k^, kij, and kj can then be calculated as averages for all sizes of con- 
crete bars of that grade. It is now practical to make a new carbon value 

Cv^ - kgC + k^Si + ki^Mh + F^P 
and the relation between the chemic^ analyses and as is 

(7g = D + ■ 

where D = k^^ is a measure of dimension. 

It is possible to make a diagram of the relation between and 
ag, where the spread of the values can be t^en into cons i^^^ 



0.45 0.50 055 060 065 0.TO 

Figure 8, 
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When the heat is in the soaking pit and the rolling mills get the 
carbon values from the lab, it is possible to decide whether the heat 
can be rolled to the intended size or if it should be stored as billet 
and rolled on another dimension. 

What then are the objections with regard to the exactitude of the 
results? The testing of as has a spread of about ±0.5 kg/imnS. Fur- 
ther, the chemical analysis of a single rolled bar deviates often quite 
a lot from the analysis of the heat. Then the equations were counted 
from the analyses of tested bars and not from the analysis of heat. Fin- 
ally, the rolling temperature in the finishing mill must be constant 
since it has great influence on the physical strength. Development, how- 
ever, goes forward to a stabilization of production. The equations shov- 
ing the relation between chemical analyses and in this case physical 
strength will also serve as an instrument controlling production from 
molten steel to finished product. The carbon value can even be usqful in 
connection with the work of minimizing the number of grades in the plant. 

This study has, like most of them, not ended up in anything definite. 
It has, however, shown that the equations and particularly the carbon 
value are useful tools in controlling the production. 

Closing Remarks 

Statistical thinking is nothing new, but it has now been systema- 
tized and it is accepted not only by ^fenagement but also by technicians 
in general. The cooperation has been good, mainly because the work has 
been carried out quite openly and not in any form of secrecy. In Sweden, 
the Swedish Iron Masters Association have arranged a statistical bureau 
to keep in contact with the steel plants. The question how to train 
technicians for statistical work is actualized, and the way by group- 
information, as it has been practised here in the U.S.A,, seems to be the 
best. The A.S.Q.C. has in a marvellous way promoted this development. 
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STANDARDIZATION AND QUALITY COmOL 
John J* Dunn 

Office of the Assistant Secretary of Defense (Supply & Logistics) 

■ ii ■ ■ ■ ■ . ■ 

It is indeed a pleasure for me to he afforded the Qpportiii^ to 
participate in the Seventh aruiual convention of the American S^iety 
for Quality Control. I propose to take advantage of this opportunity 
to examine with you some features of inspection and qualii^ co|itrol 
in which I have a very direct concern. 

My interest in quality control steins from ny responsibility for 
the Defense Standardization Program in which the technical require- 
ments for quality control are of great importance. The Defense 
Standardization Program undertakes to reduce t^e variety of g6<ids and 
services required for logistic support of our operating military 
forces in four basic ways: 

1. By reducing the variety of items presently in the supply 
systems: through the eliminaiibn of duplicates, near-duplicateef and 
of unneeded and obsolete items. This process we refer to as *’|impli« 
fication**. 

. ■ 

2. By the development of engineering standards for itei^s and 
their components which will limit selection in the design of new Items. 

3. By standardizing practices and procedures associated with 
the design, development, production, shipment and use of items ^ In 
this connection, standards are developed for such things as dr^ting 
room practices, packaging, quality control, etc., when these practices 
are applicable to many items. 

h* By the establishment of uniform requirements in the speci- 
fications used in procurement and the standardisation of practices and 
procedures peculiar to individual items. 

It is, of course, in the latter two areas in which my interest 
in quality control lies — standards for established practices 
fecting a great number of items, and uniform requirements for ifce 
quality assurance of Individual items. 

Before identifying the nature of my concern with quality control, 

I should like to have the record show that I am quite aware th^t, in 
many respects, the art of quality control, as applied to the purchaser 
rather than the producer, has not attained the degree of stability which 
offers the essential ground for the development of standard pr^tices. 
Yet, I suggest that the degree of stability is perhaps much greater 
than is recognized by the profession itself. In your natural concern 
to develop and perfect the techniques which distinguish this pi^fession, 
you have perhaps done yourselves a disservice by having given iinsuf- 
ficient attention to abstracting from your experience those policies 
and principles underlying your work which would further promote and 
solidify the gains already made in this field. 

Ify interest in quality control, therefore, is to translate to the 
maximum extent an art into a science, so that those functions df manage- 
ment for which you develop your techniques are enabled to employ them 
most effectively to improve the activity in which they are employed 
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and enhance the profession ^ich provided them* 

If my remarks are to be understood, it is essential for me to 
make my position clear in the context of my own responsibilities and 
interests in this area* Obviously there is a difference of degree 
and, in some measure, of kind, in the interest which people involved 
in the production of materiel have, as distinguished from the interest 
which must exist on the part of the Department of Defense as a consumer 
of this materiel* In this connection, therefore, my concern stems 
from the necessity for providing military specifications which set forth 
clearly and accurately our requirements, utilising where we can, the 
tools of statistics and quality control engineering* 

Let me further clarify the position of the Department of Defense 
in this matter* Obviously, industry is concerned with quality control 
as a technique for the in-process phases of production of an item* Its 
concern properly is fabrication of an it«n from the raw material throu^ 
the finished product* The major purpose of quality control in this 
effort is to determine the factors which will result in a suitable 
material capable of being produced and sold* For this reason it is 
essential to the producer that every process variable be studied and 
its effects anticipated* Quality control in this sense is directed 
to the avoidance of defective materials and to the production of items 
complying with the requirements of the purchaser or of the designer* On 
the other hand, the interest of Idle consumer must obviously be to build 
quality assurance requirements into his purchase specifications which 
will, while insuring a suitable product, still minimize the cost and 
impact of inspection and testing* To the extent this is feasible, an 
item containing the optimum amount of utility is made available at 
least cost* 

It should be obvious that it is to the mutual interest of the 
vendor and purchaser to have specifications that are rational and 
intelligently stated* There will then be a minimum of misunderstanding 
and a minimum of waste of time, effort and resources involved in the 
production of all items so specified. This is the point which we feel 
is of mutual concern to you who are present here today and to the 
Department of Defense* That is, in the evolution of control techniques 
to avoid producing defective materials, tools have been developed which 
minimize the cost of production of each item by applying to the total 
number of items produced, the intelligence gathered from previous 
experience in production. It is my belief that the unfortunate situa- 
tion of the specification developer today is that the same intelligent 
application of effort has not been given to the preparation of quality 
assurance requirements of purchase specifications* 

Statistical techniques, control limits, process variables, and other 
such criteria have been useful in the development of the proper measure 
of control over material in the production end. It should be apparent 
that it is to the interest of the Government to have a similar type of 
scientific control and approach to the development of specifications* 

This has not been given sufficient recognition in the past. More at- 
tention must be paid in the future to the application of the same types 
of resources which have been applied to the control of production to 
assure that specifications state in the same definitive terms the mini- 
mum requirements which need to be stated* This will assure sampling 
plans being on a rational basis and that classifications of defects and 
acceptable quality levels are defined within limits developed through 
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the media applied in the past to production quality control techniques. 

With the development of the appropriate mathematical and B|atist- 
ical and related techniques in the development of acceptable qu&lity 
levels, classifications of defects and rational sampling plans, it is 
anticipated, in lieu of the haphazard and conglomerate nature of 
present sampling plans or techniques for selection of such plan|^ or for 
the delineation of limits of asceptability, that patterns, principles, 
and uniformity will emerge. This will place quality assurance provis- 
ions on a rational basis. The same intelligence can then be applied 
to the methods of developing quality assurance techniques and p!i:o visions 
as has been characteristic of the gradual improvement of production 
quality control techniques. 

This, we feel, is a matter of joint interest since it is ofeyipus 
to us that any irrationality which creeps into our specifications affects 
you directly as the contractors and vendors who must furnish ^ m^^ 
in compliance with Government specifications. To the extent that we 
can make our approach as rational as the approach to quality contarcl 
in production, we will not only improve our relations with industry but 
we will reduce the costs of fidlure to c^^ intelligibly and 

adequately with the people who are expeo^d to serve the Governj|iient* s 
needs. It is not easy to face a situation in which the will to | correct 
any deficiencies is as great as it is in the Department of Defense 
today, and yet to be frustrated because the techniques and tool’s which 
should be available to be picked up are not recognized. Our awareness 
has developed in this area but the means to correct the situation 
unfortunately so hidden or else so dedicated to only one aspect of the 
problem that all our efforts in this direction are not o plaimed and 
rational basis but are haphazard and empirical. This results in such a 
variety of requirements being placed on the industry, often on the one 
industry by a number of requiring activities, as to constitute a very 
real hazard to proper working relationships between the Goverhm^t and 
Industry. 

I am therefore addressing myself today to the task of bringing to 
you the questions which ex5. at in pur minds. I hope that develb|meht 
of these problems will stimulate added thought on these questions. In 
that way, any irrationality which may exist in the military s|)ecifica- 
tion system will be removed. VJe recognize military procurement' as one 
of the largest factors in industrial production today, and stability 
in this area is an urgent necessity. 

I should like to illustrate the theme of ny talk by examining two 
feattjres of this circiMstance— one, what guidance has the quality 
control engineer provided the designer in the selection of thosj^ 
techrdques of quality control which will give the designer the jHeeded 
assurance that his item, if it meets these requirements, will llti fact 
perform as designed? — and two, has the quality control engineer, in 
the absence of this guidance, unconsciously assumed some share of 
responsibility for the performance of the item which the designer 
cannot properly share with anyone else? 

In considering these questions, let us look at AQL's and CD's. An 
analysis of military specifications today will disclose that a 
variety of quality control requirements are employed. These wiH vary 
from a simple requirement to test ** 2 out of each lOQ** to the mdist 
complex array of visual and dimensional examination procedures! of 
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acceptable quality levels with accompanying sampling plans; of classi- 
fications of defects for major, minor and critical features of parts, 
materials and end items and the like* 

While the variety of techniques selected to assure quality are 
not subject to criticism, since this may reflect only the ingenuity of 
the profession, what is distressing is that there is no discernible 
pattern among these many techniques which would assist in establishing 
criteria for their most effective employment* Are these requirements 
conditioned by the nature of the item, by the nature of the industry, 
by the application for the item, by the method of fabrication, or by 
other constants? If so, what is the nature and degree of influence 
which these factors exercise in properly selecting a sampling plan, 
an AQL, or a classification of defects? 

These questions must be answered if management is to be enabled to 
uniformly and effectively employ the fruits of your labors* While your 
energies are quite properly devoted to the development, validation and 
refinement of your techniques, criteria for their employment in the 
area of quality assurance as well as in the area of quality control 
should hold equal priority in your research* 

Again, looking at classifications of defects as a tool of quality 
assurance, we find that the nature and content of these documents show 
extreme variation* One theory concerning these documents is that they 
are designed to provide the specifics of *»good workmanship”* By pro- 
viding definition to this technical requirement, the area of accept- 
ance judgment required of the inspector is accordingly circumscribed* 
This is good, of course, since it minimizes differences between the 
contractor and the customer and increases the chances for equal treat- 
ment of all vendors* 

Yet you will find in many of these documents quality control 
requirements which go far beyond those associated with workmanship* 

There are requirements with respect to dimensions, materials, and other 
technbal requirements* The requirements for these features of an item 
are normally called out in Section 3 of the specification* 

With respect to those considerations which have a direct bearing 
on the pricing of a product offered to the Government, there are two 
extreme viewpoints on specifying AQL’s, sampling plans, and CD* s in 
specifications* One viewpoint is to exclude them completely from 
specifications. These provisions are then made available only to the 
Government inspector who may need them to check the products for 
acceptance or rejection* The supplier and the Government inspector are 
not limited in their relations by rigid and detailed quality assurance 
provisions. The supplier will have a free hand in establishing what- 
ever inspection and quality control system he considers necessary. This 
procedure would avoid an interpretation of the specification by the 
supplier that a rigid application of fixed inspection procedures by the 
supplier is required* 

The second vieiwpoint is to prepare complete and detailed quality 
assurance provisions for specifications. Aside from the fact that it 
is the policy of the Department of Defense to prepare complete and 
detailed provisions whan the necessary data is available and pertinent, 
there are definite economic advantages to this procedure. The supplier 
will have guidance as to the inspection procedures to which his product 
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may be subjected; the supplier will have an equitable basis for e|tiinat* 
ing costs for bidding on Government contracts; the same inspection 
standards are used for all suppliers of the same iten; and Governlient « 
Industry relations are improved when inspection standards are clej^ly 
and uniformLy defined* 

An examination of all the information that has ccmie to our ■ 
attention in tbit area has m^de it al^daptly clear that three questions 
have^ to. be ..an.sweraA*...:. 

!• V/hat are the engineering and statistical criteria for 
specifying an acceptable quality level (AQL) and sampling plan? 

2* What Are the engineering and statistical criteria f or ; 
specifying the degree of importance of the quality characteriatics of 
an item for inspecti oh jkrpbses and classifying d as being Mnor, 

major, or critical? 

3# What are the economic factors which are inyplyed^^^ 
ing an acceptable quality level and sampling plan? 

Many rules-of- thumb are used in specifying AQL*8« A single Stand- 
ard value may be used for a large class of matexlals or commoditijes, 
irrespective of the nature of the specific item* In other cases,: the 
AQL represents an Intelligent estimate on the part of the development 
engineer or specification incite r* For some itews there is a wealith of 
quality history records from past procurements for estimating realistic 
AQL ^8* But when this info matlon is not available, the AQL speclified 
in the specification may not be realistic. For instance, the AQL may 
not be in line with good industiy practice or with the needs of tihe D 
The information feedbacl^^ the supplier or Goyernment inspector to 
the preparing activity may ^en Indicate the need to modify the Specif- 
ication, often a slow and tedious process. Further, this corrective 
action doesn't help with respect to the general run of new specifica- 
tions or revisions of speciilcations which for tjie first time inijjroduce 
these new statistioal tools for product inspection. 

With respect to statistical sampling plans, specifications contain 
a variety of requirements for specifying lot size, sample size, and 
acceptance and rejection numbers for products. The lot size may be 
arbitrarily fixed at a large or small number, or may be varied tp 
cover a day*s production or one process cycle. The sample size, often 
dependent on the lot size, may also be fixed oi^ Yaried. It is allsp 
necessary to determine whether single, double or sequential sampling 
will be specifledo Acceptance or rejection may also depend on tptal 
numbers of defects pr may by the number of defecti'^ ■ 

products. Thus, there aire many possible combinations from which a 
particular sjmipling plan may be chosen. The criteria for determining 
the choice should arise f;rom the group such as this 

which has done so much definitive work in the arpa of productibn Iquality 
control. 

The other issues to be considered are the CD’s^ used In attribute 
inspection, the most common statistically-based inspection prbceoitfe 
used in military specifications today. CD's are classificatipnS|: in an 
assumed order of importance, of those characteristics of products which 
require examination to determine conform with, the technical require- 
ments of the specifications. How to c^jectiveiy classify these P 
characteristics? How to deteimiine^^ of detail required ; of CD's? 

Is the classification as critical, major and minor sufficient pr ; dp we 
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also need the categories such as minor minor incidental, and 
special, now to be found in specifications? Without soundly based 
criteria for answering these questions, there is confusion in this area 
of specification requirements# 

The question of CD’s is bound up with AQL’s# There is always the 
question whether the AQL and related sampling plan specified for a 
commodity are reasonable# The amount of examination specified In the 
quality assurance provisions seem excessive when applied to products 
with a high degree of uniformity; or the specified examination may be 
inadequate when applied to products that are not of a highly uniform 
quality# One interesting case which demonstrates this problem occurred 
recently with respect to bar soap# Soap is recognized as a large-volume 
product of extremely uniform quality# In one instance an AQL of hSi was 
proposed# This would require sampling far beyond the number actually 
required to determine quality of such a uniform product# For such a 
product which is very uniform, it was indicated a sample of 10 mi^t be 
sufficient for all the physical characteristics irrespective of lot size* 
Therefore on what basis is an AQL decided upon? 

Another theory is that classifications of defects may not impose 
requirements beyond those of the specification# Yet we find many 
instances where this is done. For example. Military Specification 
MIL-C-I283A specifies a 5-gallon military gasoline can, known popularly 
as the Jerry Can# 

A close study of the specification and associated production 
drawings shows that the CD demonstrates as defects forming a basis for 
rejection tmder the appropriate AQL of at least 3 characteristics not 
described outside the CD, although these are reasonable criteria to 
apply as a test of ’’good workmanship"# In another case the height 
tolerance varies between the drawing and the CD# On the other hand, 
MIL-C -1398hA specifying a 5-gallon military water can, also the Jerry 
Can, but for another application, not only raises the same sort of 
questions, but introduces a conflict in classification between the two 
Jerry Can specifications by requiring the tolerance on closure seam of 
the handle to be 1/32" in one can and l/6h" in the other# Here, indeed, 
is cause for achieving some semblance of order# 

Again, are classifications of defects properly a part of the 
specification and, accordingly, of the contract? Practice within the 
military varies in this respect* 'This variation will continue until 
the nature and function of these technical documents is clearly es- 
tablished, and criteria for their use establi^ed# 

Let me cite additional examples of diverse quality assurance 
requirements s 

1, MIL-P-35002, Paragraph h#2#l - The following statement 
appears, "The Government reserves the right to classify as a defect any 
departure from the specification not specifically listed in these 
tables#" This permits the Government inspector to add to or delete 
from requirements which have been made mandatory upon the manufacturer# 

2# MIL-C-13l449(Ord) , Paragraph 3*1 *3 - The table under this 
paragraph has a column heading "major or minor" defect. No guidance is 
provided concerning such a classification. In addition, paragraph 3#12 
of this specification has, in effect, a second listing of defects which 
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covers performance testing, Two overlapping listings of defects in the 
same specification is confusing, 

3, MIh-A-13l488(Ord), Paragraph 1|,P,1,1 - Listing of defects by 
referencing the paragraphs in Section 3 does not provide the definition 
necessary. For example, paragraph 3#7*2 states that welding or braziing 
shall be acceptable as to quality, workmanship, and appearance, -Simi- 
larly paragraph 3*7.1* 

U, MIL-.C-.13993{Ord) , Paragraph 14 , 1.2 - Reference is made tp 
incidental defectf. No guidance is provided as to the difference 
between minor and incident^ defects 

5, MIL-I-6870(ASG), Paragraph 3*l4#l,l*l - 100 percent inspection 
is required. This Division has no guidance to pass on to the depart- 
ments as to when to use IQO percent inspection as against less ti^an 100 
percent, 

6, MIL-STD-152, Section 3 , Paragraph 3*2 - The sampling for 

envirpnmentdl testing requires that **1 or mqi*e ite^^^ selected^^^^ 

from the first 10” shall *15^18 requires the Government inspect- 

or to use his own judgment as to the number of samples to select^ Again 
no guidance is ayaiiaKLe to this Diyis ion which would enable the^^ 
departments to make more definite statements in specifications oh this 
point. 

The previous questions have been discussed from 
point of view. Serious consideration must also be given to the economic 
factors. Supposedly, AQL*s, CD's, and statistical sampling plans have 
received wide recognition as quality control tools because the Govern- 
ment will be assured of obta^ a required quality at a product cost 
comensurate wi^ its needs. Government inspection costs should! be 
reduced in proportion to the employment of these tppls In the prb<^ 
process. Production efficiency is promoted because the supplier; is 
able to gear his operations to these predetermined requirements. These 
considerations are sufficiently important to justify a careful eiicainin- 
ation of the economic factors inyolyed in de^ quality standards 

for specifications. The effect of these requirements on the Government 
and the supplier should also be studied since quality assurance hroHs- 
ions of specifications should be so written as to promote maxlrnujin 
cooperation between the Goyerwnent and industry. 

Questions such as I have suggested in the last fev minutes have 
been repeatedly asked, and the answer has sometimes been ''Ask the 
Quality Control Engineer, He knows,” This may be so. But, if'this is 
SO, surely he can reduce his knowledge to principles available all 
who would know for the engineer, and technician tp select 

in order tp assure Jhha product will perform as designed. 

And, if a failure of the hMdl^^^^ to if»et^w fs a basis 

for rejection, should the designer or the Quality Control EnginiefSp 
determine? This is a yitaj question if an organization is to b^ able 
to fix responsibility with certainty, 

I submit that the interest of quality control requires thai a 
precise delimitation of responsibili in these areas be establishedo 
The future of this profession could be seriously affected by an -in- 
definite continuation of the existing uncertain situation. The 
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integrity of the role of quality control principles in Government 
specifications is at stake* 

Again, if quality control is to assume some share of responsibility 
for design, self •interest requires that the extent of its responsibility 
be defined* Only in this way can it pursue the objectives of its 
function with steadfast purpose. 

The cost of a product to the Government may be materially affected 
1:^ the quality assurance provisions of the applicable specification* 

The actual effect will depend on the specific provisions of the sped* 
fication and the contract* If the supplier is required to inspect the 
products exactly in accordance with the quality assurance provisions of 
the specification, he may make an additional charge for this service* 

If the quality assurance provisions of the specification are considered 
only as criteria which should Insure adequate products and the supplier's 
own inspection and quality control system, while not directed to the 
specification, is adequate, there is no additional cost factor and 
therefore no increase in pxice of product should be necessary* 

The improvements in the techniques for assuring quality and the 
economy with which these Improvements have been attained in the last 
twenty years is well established* Perhaps now is a good time to 
consolidate the gains, and establish the benchmark from which future 
achievement can be measured* Summarising, then, the simple points I 
have presented* Identify the nature, function and criteria for 
application of the quality assurance techniques which have been so well 
developed* With this knowledge in the hands of management and the other 
echelons required to employ your techniques, further progress in this 
field will be accompanied by the understanding and support necessary to 
the advancement of your profession. 

While my remarks may appear critical, the problems which I mention 
are recognized by the responsible quality control officials of the 
Department of Defense, and research on these problems is proceeding* 

This research, however, can certainly benefit from study within the 
profession generally. 

When we examine the economic and engineering and statistical 
factors concerning the use of quality control techniques in specifica* 
tions, we feel certain that it should continue to be *Uie policy of the 
Department of Defense to include detailed and complete quality assurance 
provisions in specifications* We are also deeply concerned with the 
need to develop appropriate management policies in this area* I hope 
that the questions which I have discussed here will command your serious 
attention so that the criteria needed for such policy will be studied 
and developed. Without the criteria and the policy, it will not be 
practicable to promote the most effective use of these advanced tools 
in the standarcULzation program* 

Essential to using these new tools or techniques in standardize* 
tlon is uniformity of practice* It is necessary that the military 
services apply the same or similar inspection procedures when procuring 
the same or similar items for the same use* At present, the confusion 
that exists in writing quality assurance provisions does not permit us 
to standardize these practices* 

In conclusion, it is hoped that the necessary data and information 
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required to prepare guidance for applying quality control me thoda ; and 
techniques to Government quality assurance requirements amd for 
developing the required policies for their application will soon ^ 
available, When that stumbling block has been overcome, we hope |o 
continue to promote flexible but uniform practices, and thereby a higher 
degree of efficiency in our procurement program. 
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I^OCESS COiraiOL IK A tTOB-SHOP 

Frank Caplan, Jr* 

Westin^ouse Electric Corporation 
Abomic Fuel Departraent 

When statistical quality control techniques were first dev^ 
it was felt by many that these methods applied specifically to large 
Industries which mass-produced great volumes of identical items* ' A 
number of years later, medium-sized and even small companies producing 
some voliame of parts, supposedly identical, were making use of statis- 
tical techniques to good advantage. Applications in the Job-sho|), how- 
ever, up to the present have been few and relatively poorly documented. 

The system which 1 will describe was devised for a development shop 
where the great bulk of material produced fell in quantities of one to 
twenty. The parts ranged in size gears to large forgings and 
castings*" Types of operatlohs included lathe, drilling, grindi^, ver- 
tical turret lathe, horizontal boring mill, and sheet metal fabrication 
as well as hand rework operations. Althou^ there were some vreaeombly 
large volume items produced in the shop, these were not covered iiy this 
system but a different one was developed for use in those areas* ; 

Since the .above -listed operations cover the bulk of machinii^ prac- 
tice in American Job-shops, I believe that we can how throw away ' the 
attitude "it * s all ri^t for Joe Blow, but it won*t work in my sljiop," 
and see whether this technique actually can be applied geneiaily^ 

The first step in establishing i the system was to develop and adopt 
two points of philosophy. The first ail-important point was that the 
operators were not producing parts as such but were producing inspection 
points • Thi s immediately t ra,nslated to a common level all operations on 
all machines and handwork. It didn*t matter whether the inspection 
point was a diameter or the removal of burrs around a drilled hole. In 
either case> they could be compared directly as representative of 
whether or not the machine, the man, or the method was capable of doing 
the work i*equired. 

The second important point of philosophy was that we were not in 
the least bit concerned with punishing people who produced defective in- 
spection points. We wanted to determine only what the cause island 
correct it so that defective parts would not be produced in the 
Therefore, a basic parb of the system was the requi3:ement that th|s fore- 
man investigate and report on each out -of -control point* 

Each inspector carried a notebook whose pages! were wade up like 
Figui^ 1. In this, he recoiled the machine nimiber, how many points he 
had inspected during the shift, the proper shift to be credited -^th 
these points, and the number of deviating points he had found. lie then 
signed each page and turned them in to his foreman. The following morn- 
ing, the sheets were collected by a representative of the Qui^ 
trol Depirtment and tabulated on floor charts similar to Figure 
These charts were posted on large easels in each department and dkfried 
the infoimation for a two -week period. showed the nmber of de- 

fects found and the number of inspection points examined for each shift, 
as well as the cummulative defects and inspection points over the| period 
of the chaiij. These were charted by shift for each machine in the area 
— in rework by the type of defect* Since the process average haid been 
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calculated in the previous period, whether or not the indicated results 
were out -of -control could he determined by reference to a number defec- 
tive table which sets up control limits for a wide range of sample size 
and fraction defective. Numbers defective on the high side of the 
allowable value were circled In red; those below the low limit were in- 
dicated in green; and the charts presented a very clear picture of the 
q.uality effort in the department. After posting these results, the 
Quality Control representative posted charts similar to Figure 3 in the 
office of each General Foreman showing the results of the previous day*s 
activities for each of his foremen. 

Similar charts recapping the operations of each General Foreman 
were posted in the office of the Superintendent. 

Ihis provided for a continuing emphasis by each level of super- 
vision on quality problems. In fact, as a direct result of this system, 
it became Imperative for the foreman to investigate every deviation im- 
mediately in order to be able to answer satisfactorily questions which 
he Jmew would be forthcoming. In order to aid him in this area, the in- 
spectors were instructed to notify the foreman as soon as any defective 
material was found rather than waiting for the normal time lag when the 
information would be posted on the floor chairb. The foreman then in- 
vestigated each such incident and filled out the Foreman *s Deviation 
Report, Figure 4. In this, he identified the difficulty and then attri- 
buted the defect to the responsible area and either to operator or non- 
operator error. If he attributed the defect to causes outside his own 
department, he was required to obtain the signed concurrence of the per- 
son in charge of that department. This report was then signed off by 
the General Foreman who would also adjudicate any disagreements that 
arose. An important portion of the form is a section devoted to action 
taken to prevent recurrence. Follow up on this by the quality organiza- 
tion contributed considerably to a sizable over-all reduction in the 
defective material produced. 

Quality Control reports were issued monthly as shown in Figures 5 
and 6. These showed the departmental standings and also the defect 
figures chargeable to various causes. By this means, quality improve- 
ment effort could be concentrated in areas where maximum returns could 
be obtained. 

In the actual installation of the system, each department was han- 
dled in turn and meetings were held with every foreman, appropriate 
union representatives, and the inspectors to make sure everyone was 
fully aware of the program and its goals. Although there was naturally 
a certain amount of distrust initially, as the system operated and more 
and more departments were e^tposed to it, a spirit of cooperation devel- 
oped which contributed significantly to the success of the operation. 

The experience described above covers a system which is applicable 
to almost any job-shop in the country. It provides a reasonably simple 
and inexpensive statistical control chart system for considering as one 
what previously were considered widely separate and distinct operations. 
It is an invaluable index for demonstrating whether or not your job -shop 
has the basic attitude of "making it ri^t the first time" and provides 
a technique for reaching and continuing to hold that very desirable 
goal. 
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FOREMAN'S DEVIATION REPORT 


> A OPERATION NUMBER 

&i4f 3/x/^C 


PART NUMBER AND NAME r\ 

3 OH 3 (>2.7 



NO. OF DEVIATIONS 


OPERATOR ERROR 


CAUSE OF DEFECT 


FAULTY MACHINE OPERATION 


MEASUREMENT ERROR 


POOR SET-UP 


MISREAD PRINT 


WRONG TOOL 


OTHER (specify) 


OPERATOR 

//^ 

SHIFT 

3 


NON-OPERATOR ERROR 


CAUSE OF DEFECT 


PRIOR OPERATION 


MACH I'NE 


PLANNING 


ENGINEERING 


HEAT TREAT 


TOOL I NG 


MATERIAL 


OTHER (specify) 



comments: 

/in 




cAJ /. 47 


ACTION TAKEN TO PREVENT RECURRENCE: 




DISPOSITION OF part(s): 


GENERAL FOREMAN ’ S A PFROVAL 
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FIGURE 4 
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FIGURE 6 





























QUAUTI CONTBOL*S OBUGATION TO MANAGEMENT AND 
CUSTOMER ON RELIABILITY OP COMPLEX Ti^APONS 

H. 0. Williams 
Douglas Aircraft Co*, Inc* 

The subject of Quality Control's obligation to Management aM the 
customer on reliability of complex weapons is by no means a new sub- 
ject, as we in Quality Control in the aircraft industry have been en- 
deavoring to fulfill this responsibility for many years, and dui|iag 
all this time. Quality Control has been vitally cbhcemed with safety, 
dependability, and service life of the final product delivered to our 
customers* 

Recently we find that someone has coined a new phrase for iis* 
Reliability I What is reliability? Is it any different from what we 
have been stzdving for these many years? We believe that Management 
and customer alike are definitely concealed with the following three 
basic considerations: 

1* They want the best product it is possible to produce. . 

2. They want the best product possible to produce for the ‘ieast 
amount of money* 

3* They want the product on time* 

Now, how do we in Quality Control meet these resix>nsibilitiss? 
Since Quality Control does not design and engineer the prcduct 
volved, nor does Quality Control manufacture the product involv^4l, our 
responsibility rests with the assurance that the parts, component, 
and end items are manufactured to the requirements of the designer's 
dream and the engineering blueprints and specifications* And, sb in 
order to do this, we are charged with the responsibility of organizing 
and maintaining an effective and economical quality control system* 

This system shall have been planned and developed in conjunction 
with other planning f\anctions, such as production planning and lubcbn- 
tracting planning, based on complexity of design, interchangeab|lity 
reqiiirements, and manufacturing techniques* The system shall assure 
that adequate control of quality is maintained throughout the entire 
process of manufacture, including packaging and shipping and sh^l pro- 
vide a means for the ready detection of significant types of recurring 
discrepancies together with the corrective action taken* 

We are further charged with the responsibility of issuing inspec- 
tion instructions which shall assure that physical, dimensional, and 
fiinctional properties which would affect safety, or result in substan- 
tial reduction of useability, are listed in these instructions* 

We are further charged with the responsibility of maintainiiiig 
adequate records of inspections and tests performed* These records 
shall provide evidence that the required inspection operations have 
been performed and shall indicate the number of rejections in each 
sample, lot, run, etc*, and the reasons for such rejections* The re- 
sults of interchangeability inspections and tests shall be indicated 
and all of these records shall be available to both top management 
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and the customer for review# (In fact, we have some customers who we 
some times believe are more interested in the records than they are 
of the finished product#) 

All of these responsibilities require us to continually maintain 
an educational program for in these days of increased manufacturing 
schedules, you are fortunate indeed, if you can hold on to your ex- 
perienced personnel, and you have to be content with what you can get 
in the way of new personnel# We must be forever on the alert for 
engineering and customer changes to insure they are accomplished at 
the proper time and place# This is very important and can be some 
times quite costly, as 1 am sure you will agree with me that you 
never get the same results, both quality and economically wise when a 
job is assembled and taken apart and changed, than a job that is done 
correctly the first time# 

Another very important obligation to both Management and the 
customer on the part of Quality Control is to carry on a program of 
research and developnent into new ways and means of doing our job 
more efficiently and economically# Great strides in this direction 
have been made during the last few years in the developnent of facil- 
ities and procedures in the field of nondestructive testing and 
statistical quality controls# 

One prominent factor in the success or failure of any organiza- 
tion is the spirit of cooperation that exists between departments and 
divisions of your company# Many excellent programs and efforts have 
failed because of the lack of cooperation between people and depart- 
ments# Quality Control personnel having a close relationship with 
most of the depaartments in your company, particularly manufacturing, 
can do much to encourage and foster a desire to accomplish a better 
job. 


Quality Control should be prepared to convey information to the 
responsible agencies such as the design engineer or any other agency 
in your facility responsible for the correlation of the reliability 
of the end product# This we could be in a position to do by refer- 
ring to our historical records to provide the design engineer with 
information pertaining to the in-tolerance variations that the infor- 
mation so gathered may be correlated to end item performance. 
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THE PRCXPOSiP WL STMMiyM) m ViglABEES /l 

E^grzy M* Hosenblatt aisd Wi3Lli.ain 
Office of Naval Research of Yar^s 1 

Department of the Navy 

Introduction : Origin of Staodaid 

The preparation of this Standat^ a natural consequence of the 
increasing recognition by Industry^ University and Govemnent wc^kers 
in the field of quality control of the importance of inspection by 
variables for percent defective; as a test procedrn*e to evaluate; prod- 
uct quality* In the published and tmpublished literature on qus^ty 
centred there is evidence of the contributioxua to statistical 

research in support of this test procedure and of the numerous a:^lica- 
tions of the test procedure by various activities. Some activities in 
and out of government have already prepared sets of standard sampling 
plans designed to their own preferred methods of application. The 
difference in methods of application is undouhtedly influenced by the 
availability of tbeoretlcal results at the time of preparation 6|r by 
different opinions as to ease of application. Nevertheless; these 
differences are all superficial since; basically; all percent dejfective 
inspection by variables sampling plans worthy of the naine i^e cdt f^ 
the same cloth, Xn this background; the need to prepare a mililiary 
standard for inspection by variables for pei*cent defective; to hierve as 
an edtematlve to Military Standard 10^ for inspection by attributes; 
became apparent. 

Accordingly; the Office of the Assistant Secretary of Defex^e 
(Supply and Logistics) brought together; as a team; representatives of 
the various agencies of the Department of Defense to specify the scope 
and content of the new military standard. This specification included 
types of sampling plans; lot sizeS; sample sizeS; acceptable quality 
levels; risks of incorrect decision for AQL product and the relation- 
ship among the various types of sampling plans, 

A desire of this task team to utilize the recent theoretic^ solu- 
tion; which provided an acceptance region for the two-sided test in 
inspection by variables cooq>arable to that for the one-sided te^t; led 
to a revision of the original acceptance criteria of the solution into 
a sijapler practicable form. Further discussipn of this solution will 
appear later In the paper. The theoretical solution and t^ re^sipn 
of the acceptance criteria was accooqplished meinbers of the Applied 
Matbematics and 3tati sties Laboratory; Stanford University, This group 
also coDq>leted the sam]^ng proced\ires and tables within the framework 
indicated hy the Department of Defense Task Team in the form.pf > firpt 
draft and is also responsible for the theoretical basis of the $tanda3:d< 
The Department of Defense preparing activity for the Military Standard 
is the Bureau of Chdnonce; Department of the Nsvy, This activity pre- 
pared several revisions of the Stcuada^ l^ of obt^^ng 

final concurrence among the three services in its issue. In addition; 
the Bureau of Ordnance is ccmipletix^ a report on the full theoretical 
basis of all the tables and procedures in the Standard, A listing of 
all those people who worked on or influenced the contents of thf 


/l Paper based on work done while both authors were by the 

Bureau of Ordnance; Department of the Navy 
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standard in its present form would l>e long indeed ♦ It is fair to say, 
however, that they represent leading persons in the fields of quality 
control and statistics from University, Industry and Government, 

Brief Review of Inspection hy Variables for Percent Defective as a 
Test Procedure ; If the qxaality of a product depends on a characteris- 
tic, which can be measured on a continuous scale, such as hardness, 
time, diameter, weight, etc., it is possible to use inspection by vari- 
ables as a test procedure. If the measure of quality is percent defec- 
tive there is specified an upper specification limit on the meastirable 
characteristic or a lower specification limit and semetime s both limits. 
Any unit of product for which the measurement of the quality character- 
istics exceeds the upper limit and/or is less than the lower limit is 
a defective unit. The lot percent defective, say p', is then the result 
one would obtain if he divided the total nimiber of defective units in 
the lot by the lot size. The objective of tbe test procedure applied to 
acceptance sampling is to select a sample from the lot auad decide to 
accept or reject the lot based on the collective measurements of the 
sample units. 

To develop a rational basis for tbe decision procedure, one speci- 
fies seme value of lot percent defective, say p^ as an acceptable 
quality level (AQl) and prefers to decide to accept if the true lot per- 
cent defective does not exceed this AQL value; likewise some value of 
the lot percent defective, say p£ where p£>p^, representing an un- 
desirable measure of quadity is specified for which it is preferred to 
decide to reject if the true lot percent defective is equal to or 
greater than this value. These preferences are made specific by desig- 
nating suitable r isks^ and where oCis the risk of making an incorrect 
decision to reject when the true lot ^roent defective is p^ and ^ is 
the risk of making an incorrect decision to accept when the^true percent 
lot defective is These risks represent the probability of an in- 
correct decision, or what is equivalent, the frequency in the long run 
of making an incorrect decision. An objective of the inspection by 
variables test procedure is to provide a method for making acceptance 
decisions which will be controlled within the risks specified for the 
quality levels indicated. The operating procedures provide the size of 
the sa2][q>le to select and an acceptance constant; by compaxlng tbe sazi[q>le 
results with the acceptance constant, a decision to accept or reject the 
lot is made. The procedure makes it possible to corapute the probability 
of acceptctnce for any value of the true lot percent defective, that is, 
the operating characteristics of the sampling plan. In this Standard, 
ccMputation of these probabilities is based on tbe assumption that the 
quality characteristic is normally distributed. 

Coverage of Standard 

The Standard is divided into four separate sections as follows: 
Section A - General Description of Sampling Flans, Section B - Vari- 
ability Unknown - Standard Deviation Method, Section C - Variability 
Unknown - Raaage Method, Section D - Variability known. 

Section A, the general description of the sampling plans, will 
always have to be used in conjunction with the other sections since it 
provides general concepts and definitions needed for sampling inspec- 
tion by variables. It includes such topics as Scope of Standard, 
Acceptable Quality Levels, Submittal of Product, Lot Acceptance, Sample 
Selection and Operating Characteristic Curves, 
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Sections B and C descriTje the specific procedures for application 
of the sampling plans when variahi lit y is unknown, for most applica- 
tions the variahility is unknown and either Section B or 0 will used. 
The term variability is a general one and refers to the measure of 
dispersion of the quality characteristic for the lot or process,; Wien 
variability is unknown, it is estimated either by the sample standard 
deviation TOder Section B or the average range under Section C, "The 
range method requires , for most of the comparable plans , more observa- 
tions than the standard deviation method, but has the advantage in being 
simpler in the computations required, ' 

Section D is available if the variability is known; substantial 
savings in sample size over unknown variability plans for the same 
operating characteristics can be made in this case, however, the user 
is reminded that the requirement of known variability is a stringent 
one, from a practical viewpoint , variability may be considered ^known** , 
if it is observed to remain stable over a period of time, that iq, be in 
"statistical control". 

Like MIL STB IO5, the sampling plans are Indexed by lot size, 
inspection level and Ai^L, There are 1 ? lot size intervals, each identi- 
fied by a sample size code letter, grouped into 5 inspection levels. 
Sampling plans are provided f or l 4 AQL values ranging from to 
15.0 percent, Purthermore, the risk involved in rejecting material for 
a given AKJL decreases as the lot size increases, this again follows a 
pattern similar to that of MIL STB IO5, 

The corresponding plans in Sections B, C and B were matched as well 
as possible, under a system of fixed sample sizes, with respect ^0 their 
operating characteristic curves and are extremely close, in most; cases. 
Hence, for a given lot size, inspection level and AQL, the user itey 
select a plan from either Section B, C or B, and be assured of tjie same 
probability of rejecting or accepting material for any given quaiity; 
it is important to realize the provision that the variability ha| to be 
known for the Section B plans, 

Bach of the Sections B, C and B consists of three parts; 

(1) Acceptance sampling plans for single specification li]|it case, 

( 2 ) Acceptance sampling plans for the double specification iimit 

(3) Procedures for estimation of process average and criteria for 
tightened and reduced inspection. 

The single specification limit case is encountered when the quality 
requirement Is given as either an upper or a lower limit for the:; char- 
acteristic measured and a corresponding single A^^L is specified,^' In 
this case, the acceptance criterion is given in two forms, for |he same 
sample size one form provides acceptance constant k similar to |hat 
used in the X±ka procedure; the other form provides a maximum allowable 
percent defective M and requires estimates of the lot percent defective. 
Either form may be used, since for the single specification limit case 
they provide the identical operating characteristics. 

Under the double specification limit case, the quality requirement 
is given by an upper and a lower specification limit for the chafacter- 
istic measured. If a separate A(^ is assigned to each limit with no 
specific control over the total percent defective outside both iimit s. 
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then the procedures for a single limit case can be applied to eaoh 
limit separately. This is not ordinarily considered to be a double 
specification limit case. 

In most applications of a double specification limit, one AQJj is 
assigned to the combined percent defective above the upper limit and 
below the lower limit; in certain cases separate AQL values are assigned 
to the upper and the lower limit and some control is specified over the 
total percent defective. Procedures for both the single and the sepa- 
rate AQL situation for the double specification limit case are provided 
in each of the Sections B, C and D* Additional discussion of the prob- 
lems encountered under this case is given later in the paper. 

Estimation of process average under procedures of the Standard is 
accomplished by simply averaging the estimated lot percent defectives 
for a number of lots. Procedures for tightened and reduced inspection 
based on the inspection re siilts of the previous 10 or 15 are also 
included. 

Distinguishing Features : A distinguishing feature of the Standard 
is the introduction of acceptance criteria by comparing the estimate 
of the percent defective p as ccsnputed from the sample res\iLts with a 
maximum allowable percent defective M obtained from the tables in the 
Standard. Lot disposition then consists of the following; 

If P^M accept the lot 
p^-M reject the lot. 

The maximum allowable percent defective M is an acceptance constant 
which depends on the lot size, inspection level and AQL which is 
applicable to the situation at hand. In the single specification limit 
case, p is an estimate of the percent defective above the upper or 
below the lower specification limit respectively. 

This acceptance procedure is analogous to attribute inspection 
under Military Standard IO5 where we compare the number of defectives 
found in the sample with the acceptance number applicable . We can 
set up the following comparison in a specific example. 
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EXAMPIJE 

Lot Size Inspection Level 11, AQL 1^ 

AttriTjute Inspection Variables InspecJ^ion 
under MIL*S^«109 tinder Proposed Standard 


Sample size 
code letter 


Sampling plan 

Single 

Variability Unknown - 
Standard Leviatibh 

Method 

Sample size 

n » 150 

n « 40 

Acceptance 

constant 

a B (a ■ 2.6T?t) 
n 

M = 2.71^t 

Sample res\xlts used 

d = number of defec- 
tives in sample 

p = estimate of |.ot per- 
cent defective based 
on X and s 

Acceptance criteria 

Compare d and a 

Compare p and M 

Lot disposition: Accept 

If k- (i ^ 2 . 

n 

It 

Reject 

If d>4 

n 

If 


The percent defective In the lot is estimated by computing a quality 
index, Q, from the samj^e results* An escepple of the quality index 
for the standard deviation method asad a single specification limit, 
is: 

Q = U - X 

S' 

where X and s are the sample mean and standaid deviation, respectively. 
The value Q is then used to read off the estimated percent vdefect}tve,p, 
from a table provided in the Standard. The estimate p obtained in this 
manner is the best possible in the sense that it is the unique unbiased 
minimum variance estimate of the lot percent defective. 

Most important, however, in sampling inspection by variables;; is 
the fact that the use of this estimate p provides a solution to ilie 
double specification limit problem when a single AQL is specified". This 
problem consists of providing an acceptance procedure for the double 
specification limit case so that the operating characteristics arb the 
same as that for the sin^e specification limit case. To illustrate 
what is involved. Chart I shows a normal distribution curve with the 
upper limit indicated by U and the lower liadt^ The lot percent 

defective above tJ and below L are indicated by and pj|^ respectively. 
The mathematical procedures necessary to compute the exact OC curye 
require laiowledge of p^ and p{ separately and not their sum. Hence, 
there is a separate OC curve for each split-up of total percent defec- 
tive p* which equals / p£. The procedures of the Standard using the 
unbiased miiiimum variance estimate p are such that, for practical ; 
purposes, almost identical OC cui^res are obtained for a fixed value of 
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p* regardless of this split. No other known procedtare has this property 
with such exactitude. The Operating Cheuracteristic (OC) curve of a 
sampling is shown as Chart II, Si^lar cu^es are given for all the 
plans in the Standard. It should he noted that the curves are based on 
the assiamption that the measured characteristic of the individual items 
follow a normal distribution. ci^es represent the percent of lots 

expected to be accepted for given percent defective. 

We had suggested an alternate procedure before the theoretical 
basis for the present two-sided test was developed. That procedure 
provided a maximum allowable standard deviation in conjxinction with 
two one-sided tests as the acceptance criteria and resulted in an 
adequate approximation to the one-sided test for many applications. 
However, we now consider that it has served its purpose and is now un- 
necessary as an acceptance criteria in view of the superiority of the 
now available two-sided procedure which is incorporated in the Standard - 
Nevertheless, the idea of a maximum standard deviation may have some 
value to users of the Standard in indicating an upper boxiiid for sample 
values of the standard deviation. For this reason, a procedure for 
computing the maximum standard deviation (msd) has been incorporated 
in the Standewrd. One can feel that sample values of the standard 
deviation less than the MSD help insure but do not guarauitee lot accept- 
ance. 


For the future one can envision extension of the procedures of the 
Standard for combining the results of several characteristics Inspected 
by variables and also combining percent defectives obtained from at- 
tribute and vi5u*iables inspection. Research for this purpose is pre- 
sently underway. 

Chart III gives a detailed example of the procedure for a double 
specification limit case using the standard deviation method. 
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U « Upper Specification Limit 
L « Lower Specification Limit 
* “ Percent of items above U 
» Percent of items below L 

“ Pii / Pi • Percent of items outside 
of limits 
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CHART II 


TYPICAL OPBRATIHG- CHARACTERISTIC CURYE 

A<^L » L^, Lot Size - 3000, Sample Size Code Letter L 

JTarialiles Sampling; Plan - Standard Deviation Method; 
Sample Size (n) = 40 
Maximum Allowable 
Percent Defective (M) = 2,71^ 

- Attribute Sampling Plan - Single Sampling: 

Sample Size (n) » I 50 

Maxirauia Allowable 

Humber of Defectives (a) = A 


Percent of 
Lots Expected 
to be Accepted 
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CHMIT III 


Example of Calculations Doii'ble Specification Limit 

VarialDility Unknown - Standard Deviation Method 
One Value for hoth Upper and Lower Specification Limit Comhlned 

The minirnum temperature of operation for a certain device is 
specified as 180°E. The raaxiimxm temperature is 209^5*. A lot 
of items is submitted for inspection* Inspection level II, 
normal inspection, with AQ,L » Ijj is to be used* Erpm the 
Standard, it is seen that a sample of size 5 is required. 
Suppose the measurements obtained are as follows ;; 

197®, 188®, 184®, 205® and 201® 
and disposition of the lot is to be determined. 


it ion needed 


Values Obtained 


1 

Sample Size: n 

5 


2 

Sum of Measurenient s : 51X 

975 


3 

Sum of Squared Measure- 
ments; 

Correction Factor (CF); 

(SXr/n 

Corrected Sum of Squares 

(ss)! JPxScF 

190,435 



190,125 

(975)^/5 


310 

190,435-190,125 

6 

Variance (V): SS/(n-l) 

77.5 

310/4 

7 

Estimate of Lot Standard 
Deviation(sJ_; 

8.80 


8 

Sample Mean (X) ; jS"X/n 

195 

975 h 

9 

Upper Specification Limit: U 

209 


10 

Lower Specification Limii: L 

180 

(209-^95) /8.80 

11 

Quality Index: Qu (2“*^)/^ 

1.59 

12 

Quality Index: Qj^ * (X-L)/s 

1.70 

(l95-]^0)/8.80 

13 

Est. of Lot Percent Def. above 
y (Pa) 

2.19^ 

From Standard 

14 

15 

Est. of Lot Percent Def. below 

1 (Pt) 

Total "Yst. Percent Def. in Lot 
(p): P ~ Pi 

2.85ll> 

From Standard 

2.1955i/.66^ 

16 

Max , Allowable Per cent Def . (M ) 

3.32^ 

From Standard 

17 

Acceptance Criterion: Compare 

V - \ 4 Pi with M 

2.85^(3.32^) 

From Standard 


Lot Disposition. Accept or Reject: Accept the lot, since p s: ^ p^ 

is less than M, 
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THE SCIENCE OP "QUALITY CONTROL AS AN OPEJRATION" 

Paul S. Olmstead ;! 

Bell Telephone Laboratories 
Whippany, New Jersey 

1# Introduction 

For the last three years, each newly elected Fellow of the Anoierican 
Society for Quality Control has received a letter of annpunc^ejit from 
the Chairnan of the Committee to the following effect: 

"Your election is in recognition of your important contributi<^ tb the 
Science of Quality Control*" 

The letter then proceeds to mehtipn the specific accomplishments on 
vdiich the election^^M^ 

The first Constlhution of the ^nerican Society for Quality Control 
(page 5f Narch 194b , Industrial Quality Control) gives the following 
as the Krsi p^hri^s : ^ 

"The purpose of this Society shall be the advancement of and diffusion 
of knowledge of the science of Quality Contirol and its applications 
to industrial progress*" 

In the latest Yearbook, 1955-6, page iii, the Constitution as fended to 
June 9, 1954 states: 

"Section l*b* The purpose of this Society shall be: 

(l) To create, promote and stimulate interest in the adyanc 

diffusion of knowledge of the science of quality contrdi and of 
its application to industrial processes*" 

It is quite obvious that the incli;^ion of the phrase, "Science of 
Quality Control," has not been fortuitous. 

According to Webster's Unabridged Dictionary, science is defined in 
several ways: 

"Any branch or department of systematized knowledge considered as a 
distinct field of inyestigation or study," or 

"A branch of study which is concerned^ 5 ^^ observation and claj^^ 

tion of facts, especially with the establishment of verifiable 
general laws, chiefly by induction and hypothesis," or 

"Specifically, accumulated and accepted knowledge Tidiich has been system- 
atized and formulated with reference bP general 

tzniths or the operation of general laws; ImowXedge classiHed and 
made available in work, life, or the search for truth." 

It is quite apparent that Quality Control qualifies as a science by 
these definitions. It is a distinct field. It is c^^ w|th est^ 

lishing verifiable general laws. Also, its future is based oh present 
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knowledge systematized and formulated to facilitate the discovery of 
new truths or of the operation of new laws. 

One difficulty in discussing Quality Control is the fact that its 
meaning to a particiilar individual depends on his experience in the 
Quality Control field. In general, however, the members of the Amer- 
ican Society for Quality Control are interested in the broadest meaning 
of the term. They accept Quality Control as an operation for assuring 
tne best quality for the least cost* This includes as a major part the 
"operation of statistical control," first described by Walter A. 

Shewhart in his book, "Statistical Method from the Viewpoint of Quality 
Control," Graduate School, Department of Agriculture, Washington, D. C., 
1939. A summary of recent developments in the identification of Qual- 
ity Control as an Operation has been provided by Miss Mary N. Torrey in 
a review article, "Quality Control in Electronics," published in the 
IRE Proceedings, November 1956. 

In accepting Quality Control as an Operation for assuring the best 
quality for the least cost, it is assumed that it is being applied to a 
system determined by the laws of several other sciences such as Physics, 
Chemistry, Psychology, Economics, etc* It may be of interest, therefore, 
to trace the change in assiamptions associated with various sciences in 
order to reach the goal of the "best quality for the least cost." 

First, an ideal science will be assumed. 

2. Quality in an Ideal Science 

In an ideal science, all constants of nature are in fact constants. 
All independent variables are knovm and may be determined exactly* 

Under these conditions, it is customary to consider the quality of a 
thing as a characteristic or set of characteristics of the thing* Math- 
ematically, this may be expressed as follows: 

Q = f(x^, Xg, x^, x^) (1) 

Thus, the Quality, Q, is considered to be a function of the n independ- 
ent characteristics or variables, x. It is therefore true that each 
set of x*s determines the value of Q exactly. The various theorems of 
mathematics may be used to illustrate this definition of quality* 

3# Quality in an Applied Science 

In a theoretical or ideal science, no difficulty is encountered with 
equation (l). However, in applying a science, experiments are made to 
check the equation* Since the agreement is not always exact, a modifi- 
cation must be made: 

^i * ^n^ ®i 

Here, the fimetion, f, is the same as in equation (l), Q. is the value 
of Q observed in the i^” experiment, and e^^^ is the difference, Q^ - Q, 

observed in that experiment. In some expeI^lments of this type, the 
experimenter found that, if he made a large number, the average of his 
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e*s became quite small, sometimes close to zero* As a result, he 
attributed liie e Vs to errors of measurement _ In other cases , he found 
that his average was based on ali positive (or ail negative) eVsi; 

This was attributed to systematic error or bias* At other times ^ the 
range of observed e*3 changed with each series of experiments. 

From such observations, it is clear that, to reach a point of com- 
plete determination of Q in each and every experiment, provision'lmust 
be made for unknown 3cVs in addition to the n xVf ^ of , equation ( 2) . If 
it is assumed that the total x*s for such a deteraiinatiop is finite^ 
say N, it is possible to write the following theoretical expression for 
Qs 

Q -f(xi, Xn^^, ......... V (3) 

Thus, if all N x*s were Iqipwn, Q could be determined without errbr. 
However, when only n x’s are known, the practical equation is (2) above. 

In applied science, some qualities are established on an empirical 
basis before a theoretical basi^ been discovered. In ^ese in- 
stances, it is desirable to determine an equation relating Q to the 
known x^s. Equation (2) also meets the requirements for this case but 
with this difference* ^ f, ia hot known but must be_deter- 

mined from the data. In the simplest Case, this means determination of 
the coefficients in a linear equation in a way that will minimize the 
contribution of the e.’s. The method of least squares has often! been 
used for this purposed However, in more complex experiments where 
replications are made, analysis of variance is now used to provide 
estimates of the '*best” const^^ to be derived for the function^ f. 

Recently, the notion of team research is being advocated more and 
more for applied science. This aims to bring together people frim 
several science fields t o„ work , on a single complex pro j ect . Obviously , 
this broadens the base for detenoLning quality, this will now be con- 
sidered. 

4* Quality in Operations Research 

The team approach was given the name of Operations Research -during 
World War IX. Essentially, it resulted in bringing together experts in 
various fields and thereby increased the nMber ; 6 

in one applied field to n-^-m, the number based on the combined knowledge 
of the team. Under these conditions, it is now possible to write the 
equation for as: f 

Qi - f(x^. >2, .... V Vr — • ; ^ 

This has the saiBe fom a (2) but provides for the additional 

m X* 3 that result from combining the knowledge relating to several 
fields. 

Operations Research has done a great deal about bringing workers in 
various sciences together. In particular, it has popularized ma.ny 
specialized techniques such as queuing theory, linear programmir^ and 
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the like. Specif ically, it has placed more emphasis on cost and value 
as items contributing to quality. However, the situation with respect 
to equation (4) is the same as that for equation ( 2 ). It is still 
necessary to determine whether an assumed function, f, is satisfactory 
to describe the observed values of Q, or conversely to estimate the 
”best” values for the constants in the function, f, from the observed 
values of Q. The commonly accepted procedure is that mentioned in the 
previous section* 

5* Scientific Method 

A term frequently used in science is scientific method. Ordinarily, 
this is considered to be a three step process: 

. Hypothesis 

Experiment 

Test of Hypothesis 

Hypothesis is a statement of what may be true. Experiment is obtaining 
data for the purpose of proving that the hypothesis is true or false. 

Test of Hypothesis is using the data to show vriiether the hypothesis is 
true or false. 

There have been two important motivating factors that have led to 
developing scientific method: 

Improvement in Precision of Keasurement 

Desire for Extrapolation 

In each case, the question must be raised: Will accepted theory hold? 

In many instances, it has not and new theory has had to be derived or in- 
vented. This is essentially the scientific method of discovery, a 
search for nonconformance, 

6, Quality in the Science of "Quality Control as an Operation” 

One of the primary assumptions of Quality Control is that the 
function, f, is never sufficiently well known at the start of any in- 
vestigation or repetitive experiment to serve as a complete description 
of the expected data. More specifically, it is almost certain that the 
observed data will fail to meet requirements for statistical control. 
Further, Quality Control procedure will ordinarily lead to the discovery 
of Assignable Causes of variation, i. e., new x*s. This means that the 
Quality Control procedure will detect the presence of an unknown x, 
relate it to the conditions under which it occurred, determine the mag- 
nitude of its effect, and thereby assist in its discovery and identi- 
fication. This suggests the following modification in the previous 
definition of Q: 

Q - .... *n+m+l Vm+k V (5) 
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This is equation (3) modified to include the inherent to Oper- 

ations Research q.nd to indicate that some of the remaining x^s, i&j 
may be identified t^irough the operation of 

The first step in a Quality Control analysis is to deterin^ 
tions (if)* Ordinarily, these wovdd be fpr^^^^t^^^ case where 
estimates of the constants in the function ^ f, have been inseii^ed dLn the 
equations# The next step in a Quality Control analysis is to examine 
the e*s for statistical cpiitrpl. Stated as an hypoth this iftay be 
written in the form: 

4 ) 

This- postulates .....the e3dstemce.^,of_,,an_^.^®di^^^ Causp, " 

*n+m+l^ be taken into account to reduce the e*s to A e*s# 

The simplest form of this type of analysis is the control diart*. It is 
well known that it is relatively easy to identify Assignable Causes in 
this way. ■ ■ ^ 

The Box-Wilspn Method of Response Surfaces, Jour. Roy. Stat. Soc., 
Sen. B, 13, PP 1-A5, 1951, is a more complicated procedure that also has 
as its aim the solution of equation (6). It introduce^ regressibn 
analysis and specific experimental designs useful in determining" t^ co- 
efficients of ne|? x|s that^^^^^^a^ effects of jthe x|8. 

This method does not provide for new x*s that are not related tq/1^e 
old. However, it does provide an important first step in finding new 
x*a. 


Discovery of new x* s by applying Quality Control criteria tp equa- 
tion (6) permits redeterminatiop^^ (4) to include the ;ne^ x*s. 

Up to this point, each x has been assumed tq have a fixed value 

important practical case, the value of each x will change with each 
experiment, i, even when the x ^ being held constant.' This 

leads to the f pllq^ng for Q^ : 


Wk^ ^ h 



where the E*s include the effects of minor changes in the x*3 a$ well as 
the e*s, and the k newly discovered x*s are included in the equation. 

The 35* s in this equation are used to indicate that the x*s are 
“constant” in the. experimental sense. 



Equation (?) is the basic equation for control in the science of 
Quality Control. Essentially, it states that, if each of the x*3 is 
controlled, Q will be controlled, feus, the expected value of Q and its 
expected variability can be predicted from the. M x*s and 

their variaMlities. In a production process, this means that the 
design quality, $, of the pi^jduct is related 

5c*S| of the subassemblies, piece parts, and raw materials. However, the 
variability in Q is dependent on the variabilities in the x*s as they 
are being produced for assembly. It is important, therefore, that 
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deviations from control be discovered at the raw jnate rial, piece part, 
or subassembly stage rather than in the final assembly or later in 
order to assure satisfactory quality. 

Such discovery and correction is part of the Operation of Quality 
Control, Discovery in the simplest case is based on the use of control 
charts to identify points out of control. Correction is obtained by 
feeding back information relating to these points to the individual 
responsible for the process. His action then will be based both on his 
knowledge of the process and the new information given him. Ideally, 
this action is often taken as a team responsibility with representatives 
of design, manufacture, and quality control serving on the team. 

In research and development work and also in field trials of new 
products, an understanding of equation (7) is also important. Essen- 
tially, it states that, if the basic factors, the x's, can be isolated, 
a good estimate of Q and its expected variability may be made. In one 
instance, a prediction determined from the performance of the first 800 
units of a new product was checked ten years later with a trial of 1200 
\mit8. In the meantime, some 40,000,000 units had been made with the 
usual minor modification from time to time. The new trial showed that 
the original prediction was still good. As additional verification that 
the original prediction had been sound, separate comparison was made of 
prediction and performance for each of the seven major components. All 
were good. 

It seems quite likely that the principle of control should be useful 
in studying various economic phenomena such as those related to growth. 
It is reasonable that equation (7) would be useful here. The problem is 
simply to identify the primary causal factors, x*s, establish the "best** 
estimates of the constants for the coefficients, and then study the E»s 
for control. 

Standardization, that is, development of standards, is basic to all 
science and is becoming more and more important in international trade. 
It is worth noting that the operational meaning of a standard depends on 
the concept of control. This was first pointed out by Shewhart in his 
book, "Statistical Method from the Viewpoint of Quality Control." 

8. Unsolved Problems in the Science of "Quality Control as an Operation" 

An important characteristic of a science is its unsolved problems. 
Some relate to theory and others to application. Some await the carry- 
ing out of new experiments. Others may solved by reconsidering data 
already available. A few that will require continuing attention in the 
Science of "Quality Control as an Operation” are the following: 

a. Development of new statistical techniques for detecting particular 

types of assignable causes 

b. Determination of the practical efficiency associated with the use of 

particular statistical techniques for detecting particular types of 
assignable causes 
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c. Modification of the techniques in such fields as Operations ^search. 

Cost Accounting, and maj others to include the concept of Control 

d* Organization of Quality Control itself in the broad sense of ^ inirpr 
ducing the concept of control in deterialning what is wanted^ per-* 
fozming research and development work, designing and specifying 
the product, making it, inspecting it, and testing it in service 
to see that it satisfies the wants of the user 

These are of the nature of continuing problems for which new splptipns 
will be found from time to time. From an operational view, each new 
solution represents a discovery that provides a new starting point for 
reconsidering the problem* It is the application of the concept of con«- 
trol to the science of quality control itself. 

9* Summary 

This paper outlines the development pf some basic concepts in the 
Science of "Quality Control as an Operation*" Particular attention is 
given to the meaning of Quality which is shown to have operationally 
verifiable value only when it is based on data that met a critejrion of 
control. 

The Operation of Quality Control is indicated as a self cprx*ec^^ 
one aimed at discpyering new factors, Assignable Causes, that will 
permit defining Quality within limits to meet ecpnpmic pbjective|s* 

Mention is made of some of the c^tinuing unsolved problems in this 
new science. It is indicated that their solution will itself involve 
the use of "Quality Control as an Operation.** 
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THE QUALITY MAMGER AND 
; W,,J, Hasser 
General Electric Company 

The operation of every business is based on costs . There j^re costs 
for Marketing, Engineering, Manufacturing, along with other costs that 
are necessary to design, to make, to sell and ship to the Market Place, 
products which influence custoiiier desires . 

Interwoven throughout all these cpsts are the important expense 
that are devoted to acquire quality components, to produce a satis- 
factory product and to constantly maintain the desired product -quality 
levels - 

My remarks today, will be devoted inainly to the costs related to 
assure product quality - because all industry is presently plagued with 
continuing upx^ard pressure their customers for b^^^ 

quality products. And, this pressure comes at a time when quality costs 
are at their highest level, while at the same time^many businesses are 
operating with obsolete quality practices. 

The challenge to gain customer satisfaction, while at thc;same time 
reducing the present high cost for quality, rests with the Han|S®^s of 
Quality Control, I' 

To meet this challenge, the Quality Control Manager must become 
adept in analyzing the whole business cycle of his business from the 
standpoint of quality effort and quality costs. To do this thji.re is a 
positive need for establishing quality objectives, quality goals and 
needed quality programs that will assure the success of any planned 
Quality Control act iyity. Along with such objectives, goals ahd 
programs is the need for measuring the progress of the Quality’ Control 
effort and the extent to. which ^ality Control makes a contribution to 
the business as a whole. 

As a first approach, to aid Quality Control Management, certain 
questions must be ai^SVered - such as, 

1, What are our present Quality Levels? 

2, How are we controlling these levels? 

3, What does it take in Quality Costs to support this cointrol? 

The answers to questions such as these can be, at times, very 
difficult to obtain without t^^^ methods. The need therefore is 

definitely for better measuretnent techniques. 

This need is illustrated by the story of one very ambit idus boy 
who stopped at the corner drug store to use the phone. This is the 
story that Mr. Smith, the druggist, heard. 

’’Hello Dr. Jones? Do you need a boy to cut your grass? You 
don’t? 

You just hired a boy? Well, how is he doing? Is he giving satis- 
faction? 

He is I Well, thank you, Dr. Jones.” 
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As the boy was leaving the drug store Mr. Smith expressed his 
sympathy to the boy for not getting the job, to which the boy replied, 
**0h, I got the job alright, I was just checking,” 

And so it is with the Quality Control Manager, He must also check 
and recheck for good performance . A method that we have found very 
useful in this area is the Quality Cost analysis method. To briefly 
explain, Quality Costs, as we see it, are segregated into three distinct 
areas: 

1 , Prevention cost is the money expended for the purpose of 
keeping defects from occurring in the first place. Included 
here are such costs as quality control engineering, the 
writing of quality assurance instructions, employee quality 
training and the quality maintenance of patterns and tools, 

2, Appraisal costs which include the expenses for maintaining 
company quality levels by means of formal evaluations of 
product quality. This involves such cost elements as 
inspection, test, quality audits, laboratory acceptance 
examinations and outside endorsements, 

3, Failure costs which are caused by defective materials and 
products that do not meet company quality specifications. 

These include such loss elements as scrap, spoilage, rex^rork, 
field complaints, etc. 

There is a definite advantage for grouping the Quality Cost 
elements into these three major areas - since it simplifies the 
grouping of twenty four cost elements which make up a complete quality 
cost analysis record. Therefore, instead of twenty four variables, only 
three basic variables are involved. 

These three major areas now tell us where and how much, money X'je 
are spending for Prevention, Appraisal and Failure, Hox'/ever, to 
complete measurements it is necessary to have comparison bases to 
enable us to relate these quality costs to the rest of the business 
operation. Here are three comparison bases that have been used 
successfully in some businesses, 

1 . Contributed Value . 

This is the value contributed by the product department in 
designing, manufacturing and selling the end product. It is 
calculated by subtracting the cost of outside purchased 
materials and services from Net Sales Billed. 

2 . Net Sales Jellied . 

This is the total amount that is billed, by the department, for 
products sold during a given period. 

3 . Operation Labor . 

This is the actual input of dollars for labor and includes 
good labor as well as labor losses. 
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Having three bases such as tnese will assure you that at l^ast one 
base will reflect a true indication of comparison when the othe^ bases 
are temporarily thrown out of balance by possible short term changes. 

To set up such a quality cost work sheet it is necessary to be 
sure that the cost accounting methods in a particular business biaye 
identified and grouped Quality Costs in a form suitable for the'; 
development of adequate control , 

Once a system is developed regarding the method to be used ^in 
determining a business *s Quality Costs and the bases used for ! 
comparison purposes, subsequent changes in the original bases ob.vlously 
invalidates all past data. Therefore, the importance of excerc^'sing 
judgement and caution in selecting these bases cannot be over-empha- 
sized. 

To be assured, that the quality costs used for analysis purjposes 
are dependable, the Quality Control Manager must look for three !bpec if ic 
things . 

The first is that the quality costs are accurate according to the 
definitions of the elements under the three areas, Prevention, 
Appraisal , and Failure , 

Second, to be sure that the measuring bases; i.e. Contributed 
Value, Net Sales Billed or Operation Labor, fit the ups and downs 
of the particular business. 

And third, be sure that the quality costs are issued periodically; 
preferrably on a monthly or quarterly basis. 

Now let us look at an example of how the three areas , Prevehtion , 
Appraisal and Failure, and their comparison bases, Contributed Value , 

Net Sales Billed and Operation Labor are related , This will illustrate 
how this information would appear on a quality cost report . Norj^ally 
on a standard quality cost report the figures shown would be in dollars . 
For ease of comparison of the examples shown let us use only percentages 
instead of dollars and use only two quarters of a whole year. 


Example 


Prevention 

Appraisal 

Failure 

Total 


Department Quality Costs 


1st Qtr . 

7.7% 
23.8% 
68.5% 
100 . % 


2nd Qtr 

6.4% 
23.0% 
70.6% ^ 

100 . % 


Total Quality Costs to Measurement Bases: 


Quality Cost % to: 

Operation Labor 105.0% 
Contributed Value 10.2% 
Net Sales Billed 7.8% 


106.0% 

10.7% 

8 . 2 % 


This example , as I mentioned before , has been illustrated by 
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showing only two quarters , It is felt that by establishing definite 
periods of coverage or compiling Quality Costs on a quarterly basis for 
at least a minimum of six quarters, the most effective analysis can be 
made . As can be seen from the example of two quarters , the percentages 
begin to tell a story of the cost of quality. They show the percentage 
spent in each area, the relation to the comparison bases and the 
difference between two quarters. However, it is quite apparent, the 
two quarters also show that there is still not sufficient data to make 
a decision. Six quarters will give the needed data and will show trends. 

To gain additional data, these quality costs broken down by product 
lines or segments of process flow will allow pin-pointing of the areas 
that merit the highest priority of quality control effort. To illus- 
trate how this is done and show the results obtained let us break down 
the 1st quarter into two product lines and relate them to the comparison 
bases . 

By breaking our costs down by product lines makes it possible to 
see the comparison of one line to another and also highlights additional 
facts necessary to making a sound decision. 

Example V, Department Quality Cost 

By Produc t Lines 



1st Qtr. 

1st Qtr 

1 

Line A 

Line B 

Prevention 

5.0% 

10.4% 

Appraisal 

16.2% 

32.0% 

Failure 

78.8% 

57.6% 

Total 

100. % 

100. % 

Quality Costs % to: 

Operation Labor 

124.0% 

86.0% 

Contributed Value 

11.2% 

9.2% 

Net Sales Billed 

9.3% 

6.3% 


All of the quality cost data and information is vitally necessary 
for the Management of Quality Control , There are four major results 
obtained from accurate Quality Costs, 

1. Quality Costs provide an accurate tool for measurement of over- 
all business quality performance. 

2. Quality costs are an analysis tool which are used to indicate 
where quality money is being spent . 

3, They provide a tool for programming the when, the where and the 
how of quality improvements. 

4, They make a fine budget tool to enable the forecasting of 
realistic needs. 

These four advantages assist the Quality Manager better to assume 
his responsibility of maintaining Quality at an optimum quality cost. 
Since he now can establish realistic objectives, goals and programs to 
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carry out his job and to obtain the greatest return from his organi- 
sation through better direction of effort. And even another advantage 
is the opportunity to set correct product quality levels which will 
return optimum quality benefits to the business and to the customer. 

By utilizing Quality Costs, to their fullest extent , the Manager 
is able to make his contribution to the businesses, profitability , 
assist in the realization of greater cost reductions and also Ip the 
business maintain a competitive position in the consumer market*^ 
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AN operational VIEW OF EQUIPMENT RELIABILITY 
R. Dreni^ 

Bell Telephone Laboratories^^ 


Introduction 

Some of the recent discussions ^ 0^^ of reliability have 

been perv^aded by the uneasy feeling that, li^ile a lot could be slid 
about the subject, no one was altogether certain of just ^at the sub- 
Ject was. In fact, there was some rather strong indication that' hot all 
cmcemed were talking about the same subject. 

The term reliability, it is true, is quite universally used to de* 
scribe the extent to which a type of equipment is likely to retain de- 
sirable performance characteristics. The inconsistency of usage arises 
when some more quantitative definitions are proposed. There is Cer- 
tainly no harm in having as many definitions of reliability as there are 
discussants of the subject, provided only that each one of them under^ 
standi idiat the other means by his "reliability’^ , and perhaps also why 
he considers it most appropriate. They can then compare notes ip a 
logical fashion on what their problems have in ccpnpn and vdiat cbnclu- 
sions and solutions derived by one can be used also by the other s 

It is this general topic with which this article is concerned. It 
develops first a ccmmion ground for such discussions by suggestinjj a 
fairly general concept of reliability and by exhibiting, through a few 
examples, that under certain circumstances one reliability def ini ti on is 
in fact more appropriate than most others. Later, an attempt is made to 
show that care should be taken in dra>dng conclusions ccmceming reli- 
ability improvements? Procedures, such as preventive maintenance or 
duplication of equipment, may be highly economical in some operations 
and yet quite unattractive in others. 

The discussion in this paper will utilize examples throughout to 
make its points. This has the disadyantage of making the argumeht seem 
spotty and limited. Unfortunately, it takes considerable attention to 
detail to treat the subject reasonably completely, more detail in any 
case than seemed appropriate here. The study on lidiich the examples are 
based is to be submitted for publication elsewhere. 

1 , What is equiment rellabilitY? .*1 

The impression that the term "reliability of equipment" meahs dif- 
ferent things to different people is readily confimed by a review of 
the literature on the subject. 

The general practice is, of course, to have reliability be repre- 
sented by a number which is the larger, the lower the incidence of 


failure. High favorites for t His number are the survival probability 
of the device (over some given period of time), or its mean life:. The 
opposite is also encpuntered. Th^^^ the number used for this 



♦This paper is based on work done by the writer when employed by the 
Radio Corporation of America. 
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purpose decreases with the incidence of failure (such as the maintenance 
ratio or the replacement rate), in nihich case the number is understood 
to represent unreliability. Whenever necessary# reliability is con-* 
verted into unreliability (or conversely) , scmietimes by subtracting it 
from unity, sometimes by taking the reciprocal, whatever seems most 
appropriate • 

There is a way of putting these practices on a somewhat firmer com- 
mon footing. ’Reliability broadly speaking, is a term used to de- 
scribe the quality of operation of a type of equipment in regard to 
deterioration and failure. What is needed, therefore, is a quantitative 
measure for this, taking due account of the fact that deterioration and 
failure are random phenomena. The situation is stx^ongly remindful of 
the type with which statisticians have been dealing for some time and 
for which they have found a very satisfying and flexible method of at- 
tache: When they need to measure the desirability or undesirability of 
the outcome of some uncertain event or series of events, they assign a 
numerical gain or loss to it, and use the mean value of this gain or 
loss as the required measure. 

The s^e idea can be applied here. To each failure, or series of 
failures, in a given type of equipment thez*e is assigned a certain gain 
(or loss) and reliability is defined as the mean gain (or loss) which 
the operator of this ecuiimient derives from it . 

This may seem a very artificial and clumsy concept, and quite pos- 
sibly it is. In order to assess its usefulness, it should be tested 
f r<»a three points of view: 

(1) Is there an easy and natural way of fixing gains and losses 
in practice? 

(2) Under circumstances xinder which one expects the conventional 
definitions of reliability to apply, does the one proposed 
here reduce to these? 

(3) Does the present concept shed any new light, or allow any new 
conclusions, which could not have been easily derived without 
it? 

The discussion which follows is intended to suggest an answer to 
these questions, after some preliminaries in the next section, a series 
of typical situations are reviewed which show how gains and losses can 
be chosen, and that in fact the reliability concepts are obtained which 
one would intuitively associate with those situations. 

2. Preliminaries 

Before the main topic of this paper is taken up, a few preliminaries 
may be useful to establish rapport on the terminology and notation to be 
used below. The general pattern of failure of a component will be 
called its ’’failure law”, following what seems rather common practice. 
Kathematically, a failure law can be characterized in a number of equiv- 
alent ways. Most frequently encountered is a characterization in terms 
of the probability of survival for a period of time t, which shall be 
denoted here with P 3 (t). The failure rate g(t), or the hazard, of a 
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component is also used t though perhaps not as fareq^ently. It is related 
to the survival probability by the formula 

^ li ■ ■■ 

g(t) = - ^ log F (t). 
at ® 

The failure laws which are much used in practice are the eaq^onen- 
tial and the normal. The first of these is characterized by 

F (t) * exp (- i), g(t) » i 
® m m 

where m is the mean life of the component. The failure rate is aeen to 
be a constant, namely, the reciprocal of the mean life. An intei^ sting 
fact is that the age of a component obeying the exponential law Has no 
bearing on the likelihood of failure. 

The normal law has the well-known shape which need not be re- 
produced here. Less well known may be the corresponding failure ;rate 
which is shown in Fig, 1, for several values of m/cT. The normal failure 
rate invariably rises to infinity as the age t of the equipment in- 
creases, a fact which it shares with probably the failure rates pf all 
physical equipment, 

3 * Special cases 

In this section, a review will be made of three exan 5 )les which, it 
is hoped, will illustrate the idea of defining "reliability'* as a mean 
operational gain or loss. The first of these is a situation in i^ch a 
ccmventiphal reliability concept, namely, the survival probabilit^y, has 
been patently appropriate. The point here will be to show, for cine, 
that the definitipn of reliability suggested here confirms the survival 
probability as the most appropriate, and that the choice pf gain or 
loss to be associated with the operation is a rather natural and,, 
straightforward one. The second example leads to a measure of r4^ 
liability, namely, the i^eplacement rate which is not overly cwnrapin but 
which has some interesting properties. The last example deals with a 
simple situation which has not been as generally studied but 
suggest the usefulness of the reliability concept developed here 

Each example will be given a name, hopefully a reasonably descrip- 
tive one, which is intended to characterize but hot to limit it The 
mathematical detail and its derivation will be omitted in all cases and 
<mly results will be mentioned. 

Example Is Guided missile 

This example is chosen as the first because it is conceptually the 
simplest. A guided missile, and for that matter every component of one » 
is a piece of equipment ikdidLch is considered a total loss after the first 
failure in flight. No repairs are possible then. 

It has been customary to think of the survival pliability ^ 3 ( 1 ) 
for the time of flight T of the missile as the appropriate measure of 
reliability. 
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To apply the present concept, a unit gain is assigned to each suc- 
cessful flight, and a zero gain to each unsuccessful one* The mean 
gain E >diich is in this case derived, that is the reliability as defined 
here, is found to be 


R = FgW, 

that is, again the survival probability* 

Example 2 : Replaceable component 

This example will differ from the previous one in that the device 
idiose reliability is to be investigated is assumed indefinitely re- 
placeable (like, say, a radio tube but unlike the preceding example in 
which no repair or replacement is contemplated)* It will further be 
assumed that the device is replaced or completely repaired immediately 
after each failure. 

Intuitively, such a component will be considered the less reliable 
the more often (per \mit time) replacements are expected to be neces- 
sary. In this example, unlike in its predecessor, therefore, the unre- 
liability is to be characterized, as opposed to the reliability* This 
can be achieved by assigning a \init loss or, which is the same thing, 
a gain of minus unity to each replacement and by then calculating the 
mean loss (or gain) per unit time. 

What is obtained by this calculation is a quantity which has been 
used in practice and which has come to be called the replacement rate. 
Contrary perhaps to intuition, it is not a very simple quantity: Its 
derivation from, say, the survival probability of the part can be a 
fairly tedious affair, and requires the solution of an integral equa- 
tion, called very appropriately the '^renewal equation”. > This equation 
has apparently received relatively little attention in recent work on 
reliability but it has been much studied by actuaries (l) and some of 
their results may be of interest here. 

The replacement rate usually starts out with an oscillation which 
can be quite pronounced, like some of the ones derived from the normal 
law, shown in Fig, 2. Invariably, however, the oscillations die down 
after several mean lives. The resulting plateau is called the ” steady- 
state” of the replacement rate and its level is the reciprocal of the 
mean life (l/m). There is only one failure law for which the replace- 
ment rate does not oscillate at all but is constant throughout, and 
that, as may be expected, is the exponential failure law. 

Example 3: Automobile battery 

The manufacturers of automobile batteries are in the habit of 
"guaranteeing” a certain life T for their product. By that they mean 
that if the battery fails at some earlier time t they Tidll prorate the 
original purchase price and make a corresponding allowance for the un- 
expired life towards the purchase of a new battery made by the same 
manufacturer. That is to say, they will charge for the new battery 
instead of the list price C a prorated price 

c - Irt c = i c. 

T f 
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This is, therefore, the gain iRriiich a manufacturer aerives from a,' battery 
replacing another one ifhich has failed at the time t, prior to t|ie 
guaranteed life* 

The reliability of battery, from the inanufacturer’s point of view, 
is his average income, that is, the gain per car and per month, say, 
from his battery sales. If he calculates this he finds 


R = S c 

T 


F^(T) 


f»00 


dF_(t) 

s 


This equation may not be very instructive as it stands but it ca^h be 
analyzed fairly easily. It develops that the rnaxiJimm inco^ car 

and per month) which the manufactvirer can possibly hope for, and hence 
the maximum rate of expenditure which the buying public must fear, is 
C/T; however, he can achieve this only by the miracular feat of Jputlding 
batteries which last for exactly the warranty period and fail irataedi- 
ately thereafter. It is unlikely that he can achieve this but he can 
seek to approximate it and, according to rumors, this is exactly what 
battery manufacturers strive to do. 

4. Preventive maintenance 

The examples which have been discussed aboye are descriptivie: They 
attach a numerical y be called “reliability" of a de- 

vice. This value, it is hoped, coincides more or less ikdth 
intuitively the appropriate one. However, none of the sug- 

gests what could be dphe about reliability if its value turns pqi 
than desirable. It will be the purpose of this section, and of the 
next one, to illustrate how the reliability concept introduced here can 
be used to study possible improvements. This section in particular will 
be concerned with the idea of preventive maintenance. 

The general problem of when tp attempt preventive maintena]|ce , and 
of how to design an optimal one for a given operation, is by all indi- 
cations a difficult one* In certain special cases, however, solutions 
can be obtained. One such case idH now be discussed , as an illustra** 
tion of the Sdiole concept. 

Consider a device such as the radio tube mentioned earlier 
2 in the preceding section) which can be thought of as being replaceable 
an unlimited number of times ^ However, instead of using it until it 
fails, as was assumed in that example, a preventive replacement at a 
suitably chosen age T is to be considered. The economics of the situa- 
tion is this: The price of the tube is C, and that must be paid in any 
case whether the replacement is preventive or a repair. In the;;latter 
case, however, an additional service charge P is expected. The re- 
placement age T is to be so chosen that the mean rate Pf expenditure 
(the unreliability in this case) is as low as possible. 

Example 2 has yielded a result >diich applies here: If no pre- 
ventive maintenance is carried out, the mean rate of expenditure iidll 
be equal to the mean number of failures per unit time (which is l/m, 
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in the steady state), multiplied with the cost of each failure (which 
is C+P). That is to say, the reliability in this case is 

R s= (C+P)/ni 

A study of the question of preventive maintenance yields the fol- 
lowing facts. There are certain circumstances under which preventive 
maintenance is definitely uneconomical, in the sense that it can only 
increase expenditures. This is the case ^lihere the failure rate is 
either constant (which implies the exponential law) , or uniformly de- 
creasing, In the opposite case, preventive maintenance may, but need 
not, be profitable. If it is, and if T is chosen in an optimal fashion, 
the expenditures can be reduced from the value of R shown above, to 

= P g(T) 

In the case of the normal failure law, the optimal replacement age 
can be read from Fig, 3, It is assumed that one knows (or can make a 
good guess of) the mean life m and the O of the distribution, and that 

the cost C and service charge P can be determined. The chart is then 

entered with the appropriate ratios and the correct replacement age, in 
multiples of O, is immediately evident. The cost of the operation then 
follows from the failure rate chart in Fig. 1, 

Take, for instance, a component which costs $20. It obeys the 
normal law with a mean life of 2 years, and a O' of 3 months. The serv- 
ice charge for the repair of a failure is $10. In this case, m/a * 8, 

C/P « 2, and the chart of Fig. 3 yields T/a » 7, This is to say, the 
device should be preventively replaced at the age of 21 months. The 
mean rate of expenditures (the ’’reliability” in this case) would be 
$1.25 per month without preventive maintenance, and 96ji per month with 
it. This is a saving of nearly 25 per cent. 

Fig. 3 exhibits a phenomenon which may be worth pointing outJ The 
curves are missing in the left upper region, that is, for small values 
of m/a and for large values of C/P, This is no accidental omission. 

The empty area indicates that no preventive maintenance should be done 
in that region. 

5* Duplication of components 

The duplication of components is a measure >diich, like preventive 
maintenance, can be adopted to in^rove the reliability of a device. The 
will be to show by a brief example that the reliability concept 
introduced here can be used to evaluate the extent of such an improve- 
ment . 


Consider again the situation treated in example 2, that is, a re- 
placeable component such as a radio tube. To be specific * imagine 
this tube to be part of a broadcast transmitter. In such an installa- 
tion, a duplicate transmitter is usually provided which is put on the 
air when the original one fails, to gain time for its repair. The 
question is, how much of an improvement in reliability is derived from 
that? 


In example 2, a unit loss was charged for each failure and the re- 
placement rate was obtained as the appropriate measure of reliability. 
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In the present example, a unit loss will be charged only in case; both 
transmitters fail, that is, n^en the duplicate went out, before the 
original could be repaired* To simplify things, we will assume the ex**» 
ponential law not only for the failures of the tube but also foi*; the 
repair times. 

With this assumption, the steady^state loss rate (that is, the mean 
number of double failures per unit time) is found to be 

R « 1 • _i_ 
ra ^ m 


Here, mj^ is the mean repair time. The factor l/(2 + is the improve- 

ment factor. It is the greater, the greater m is relative to n^. Thus, 
if the mean life is ten times gireater than the mean repair time, the re- 
liability is improved by a factor of 12. It can be seen from this that 
a substantial gain is possible in this type of operation from uaib of 
duplicate equipment . 

The operation described in this example is very favorably in- 
fluenced by equipment duplication. Caution is indicated, howevep. The 
gain need not be as great in all cases and in sCHne operations the ques- 
tion of whether it is, or is not, economical to duplicate is not clear 
cut. A careful analysis of what improvement can be expected will 
usually be very much in order. 


Reference : 

(l) A. J. Lotka, A contribution to the theory of self-renewing 
aggregates, with special reference to industrial replacement, 
Ann. Math. Stat.; Vol. 10 (1939), p. 1 
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QUALITY RmUIREMENTS OF AUTOMOTIVE FABRICS 

•T"' ' 

W. Ralph Strother 

Ford Division of Ford Motor Company 

Not too many years ago a car buyer had a choice of three, or four 
body paint colors and the s nui^er of fabrics. T fabrics ^ere 
plain and durable and did not necessarily match the metal trim* Times 
have changed, the interiors and exteriors of our oars are bright, lively 
and as colorful as modern home interiors. The car buyer may choose 
practically any color in the rainbow with a matching interior. In 
addition to the wide choice of colors, there are many fabrics and 
tailoring schemes from which to choose. 

In order for the stylists and engineers to accomplish this, many 
new fabrics, designs and fibers have been introduced into^the aifto- 
motive trim field. Jhis rapid change to complex trim schemes has 
necessitated that attentipn„ be given to the developuent of detailed 
quality requirements which must be met by the fabric snanufacturers* 


We could probably speak indefinitely on those quality require- 
ments which are of vital j3pnc®l^ tp X9ifP* peopler 



We will first discuss the „ overall quality re^^ automo- 

tive fabrics and then the .following specific applications in thf 
automobile body. 


A. Headlinings 

B. Seat Cushion and Back Covers 



D. Carpets 


General : 


equirem^ts of Automotive 



During the review and selection of fabrics by Styling and Engin- 
eering, the follpwing basic quality requirements must be kept in mind: 


Can the particular fabric be tailored to fit t - such as 
headlinings, cushion cpyers, carpets, etc. without \mdue h^d- 
ships to the fabricator? 


Will the Fabric wear adequately: Seam strength, snag resistance, 
abrasion, etc.? 


Will its cplorfaetness to li^, crocking, bleeding, migration. 
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and atmospheric gases be satisfactory? 

Does the Fabric have the proper hand, that is, feel? 

Will the fabric sag, stretch, shrink or elongate too much and 
become undesirable to the customer? 

Can the quality of the fabric be reproduced consistently from 
one shipment to another? 

The difficulty of achieving all these necessary requirements has 
been increasing since World War II* 

2. Quality Requirements of Fabrics for Specific Application 
A* Headlining 

The headlining is the covering of the roof interior. For 
many years the basic headlining materials were a napped woolen, wool 
blend, cotton, artificial leather and leather. However, changes have 
been made to conform with other styling changes in the car interior. 
Today you will find headlinings made from cotton, wool, synthetic fab- 
rics, vinyl coated fabrics, woven paper, moulded plastic, masonite, 
cardboard and leather. 

The more importsuit requirements of a good fabric for headlinings 
are as follows: 

1* Softness and Pliability - The material must span numerous 
radii without wrinkles. 

2. Strength - The material must have sufficient strength to allow 
the assembly plant operator to exert the required amount of 
tension on the fabric during installation in order to have a 
wrinkle-free headlining without sags, wavy seams, etc. 

3* Shrinkage - Shrinkage plays an important part in both the 
headlining final assembly and its life in the vehicle. No 
doubt, you have seen cars wherein the headlinings have pulled 
away from the back window area or from above the windshield. 
While there are numerous causes, one of the most important 
is excessive shrinkage in the material. On the other hand, 
some shrinkage is desirable, particularly in the assembly 
operation. Many minor wrinkles, sags, etc. may be removed 
by applying steam to the headlining after installation. Do 
not construe this to mean that steam is a cure-all. It is 
only an aid in correcting normal manufacturing variations. 

4. Color Fastness - Color fastness to light is one of the most 
important quality requirements in headlining materials. 

Under modem styling trends the headlining is exposed to 
more light than ever before. 

A crocking requirement was not too important in the past, 
since the headlining seldom came in contact with wearing 
apparel. In recent years, car roofs have been lowered and, 
in turn, the headlining is more likely to come in contact 
with hats. Therefore, the dye in the material should not 
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rub off easily* 

5* Stretch and Set - How much will the material stretch un^er a 
constant load and >Aiat is the percentage of stretch tha| does 
not recover* If you have a material with high stretch and 
high set characteristics you will probably e^qperience trouble 
in sagging awd fullness in the end product either during 
assembly or in customer use* If a material varies wide|y in 
stretch characteristics, from one shipment to another, the 
headlining will vary from too small to too large as the master 
patterns are made and developed for the average stretch* 

B. Body Cloth 

Generally speaking, body cloth is the fabric used ip the 
seat cushion and seat back covers. 

Some of the more important requirements of body cloth are 

as follows? 

1. Wear 

When you are shopping for a suit or coat you ask yourself the 
question, will it wear well. In the automotive field w<| do 
the same thing. The amount of wear depends oh 
Some very expensive fabrics have poor wearing qualities^ yet 
have beautiful hand and appearance* However, duck is ah 
inexpensive fabric which will wear well, but it is usually 
stiff and plain. Therefore, a compromise must be reached 
with the best possible wear for the use for which it is" 
intended, yet have all of the other necessaiy^ characteristics 
that are required. Resistance to abrasion and snagging ;are 
two of the iinportant wearing characteristics in body cloth. 

2. Strength 

Body cloth, with the exception of convertible top material, 
requires the greatest strength of all fabrics used in the 
car. It is constantly under stress and strain when the ’seat 
is occupied. There is greater strain applied to this fabric 
in the assembling of the seat covers to the springs, than in 
any other installation* If the material is cut underside or 
shrinks slightly after it is sewn into a cushion or bade 
cover, the operators assembling the cover will exert great 
strain on the fabric* Here is vdiere stretch is required of 
the fabric* 

3 * Resistance to Fraying or Ravelling of Raw Edges 

Normally, raw seam edges in automotive fabrics are not bound 
or pinked to prevent ravelling of the yam* A fabric that 
ravels or frays easily may cause trouble in the completed 
cushion cover in service; the seams will separate due to 
loss of seam width. In some instances the material Is Idge- 
folded to prevent ravelling or yarn slippage; however this 
is a costly operation and may be avoided in most cases by 
choosing a fabric with a tight weave and applying a bon4i??g 
agent to the back of the fabric. 
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4* Stretch and Set 


The lack of adequate stretch and set characteristics of body 
fabrics probably represent one of the most serious problems 
that the automotive industry is encountering today* The 
ideal fabric is one that will stretch and completely recover 
to produce a wrinkle-free seat when it is in the showroom 
and still be in the same condition months later in service* 

5 * Elongation Resistance 

The characteristic of a fabric whereby it grows or gets larger 
is usually due to increase in moisture content* This is quite 
common in all rayon fabrics* Fabrics should have very little 
or no elongation. 

6* Color Fastness 

Color fastness to light, wet and dry crocking, water staining 
and perspiration staining are quite important on all body fab- 
rics which are constantly exposed to light and in contact with 
the passenger* s clothing and 1001 other articles which are 
transported in a car. 

7. Shrinkage Resistance 

Shrinkage due to moisture in woven body fabrics is one of the 
less important characteristics, however, it should not be 
overlooked. 

C. Convertible Top Fabric 

Material usually specified for convertible tops is normally 
a 2 or 3 ply fabric with a rubber compound between the plys. 

This material is probably subjected to more abuse than any other 
fabric on the car and yet, is of extreme importance, not only in its ' 
functional role but in the appearance of the car. Therefore, it is of 
the utmost importance to have a strong material that wears well, is 
dimensionally stable, (the material does not have excessive shrinkage 
or growth characteristics), and of superior color fastness to light 
and varying atmospheric conditions. 

Some of the important quality requirements of Convertible Top 
Fabrics are as follows: 

1. Strength - The material must be strong enough to withstand the 
constant strain exerted by air pressure when driving. 

2. Color Fastness - To withstand the sun and weather exposure to 
which it is subjected. 

3 * Flexibility - The material should be flexible enough to fold 
without making too large a package or wrinkling excessively 
when in the stored position* 

k* Shrinkage Resistance - Shrinkage has probably caused more 
customer dissatisfaction than all ot-her characteristics 
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combined* The tbp becomes harder to operate, the top trame 
along the sides is exposed, and there are possibilities of 
water leaks* 

5« Stretch and Set As in most all automotiye fabrics stretck 
and set are quite important in Convertible Top Fabrics - par- 
ticularly in the ass^abling of the fabric deck to the frame* 

The operator must apply tension to the fabric in secur^ the 
fabric deok to th« frame to remove wrinkles and any fuilness 
that might exist* 

Adhesion - The strength required to separate the outer fabric 
from the inner fabHc must thriinghout 

the material* 

7* Resistance to Wicking - The fabric should not wick wh^ nor- 
mally wet but . Wi eking usually occurs around the seams where 
moisture comes in cphtact^ with rav edges of the f abric i Often- 
times the lining fabric of a top will become wet on a fabric 
that wicks badly* 

B. Resistance to Elongation - A characteristic of a fabric to grow 
or expand is usually due to moisture absorption ♦ This ' condit ion 
is generally prevalent in rayon top materials arid can cause 
considerable t^uble in the end product if hot controlled 
closely, resulting in sags and wrinkles* 

D* Carpets 

Carpots in the car of today are quite similar to those in our 
home, they too have taken on the modem look* You will find carpets in 
all shades and of all types of fibers* 

Some of the more important quality requirements of carpets are as 
follows; 

1* Wear - Once again we have a fabric that is sub ;)ect to consider- 
able wear, but the areas that are subject to the greatest wear 
are usually protected by an additional reinforcement such as 
rubber foot or heel rests* 

2* Shrinkage Resistance - Shrinkage due to excessive moisture may 
create problems after the carpets have been in use, in that the 
carpet pulls away from the scuff plates (metal covering over the 
door sill), resulting in the floor pan being exposed apd the 
carpet edges rolling up* 

3* Snag Resistance - Snagging or yarns pulling away from the fab- 
ric backing is most commonly associated with loop pile ''carpet- 
ing. If the pile pulls away from the backing easily, trouble 
may result in the cutting and sewing operation, assembity to 
the body, and in service* 

The amount of research and development required on fabrics; by the 
automotive manufa^?burers and textile mills h^^ tremendously 

and will probabiy increase as new styles, fabrics and fibers arb intro- 
duced. Frequently, when a new fabric is introduced, it presente new 
problems in that a certain characteristic has ch^ged slightly or 
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certain styling and fabrication changes require a characteristic to 
become more important than in the past. Therefore^ you can see that 
the task of evaluating and revising quality requirements is a contin^' 
uous job. 

The Ford Motor Company has been, and still is, conducting an exten- 
sive research and development program on autcmotive fabrics to assure the 
consumer of quality in the new materials that are constantly being intro- 
duced. 

One approach in our quality research and developaent program is 
that of working jointly with the fabric suppliers on particular problems 
to be solved. For example, a new convertible top fabric was introduced 
four or five years ago. The material had superior colorfastness to 
light, weather, age, etc., which was not available in other comparable 
fabrics, but the fabric had a high shrinkage factor. By working closely 
with the textile mills and fabric finishers the shrinkage was reduced 
below that of the previously specified material. As the result of the 
solution of the shrinkage problem in the top material, Ford has been in 
a position to offer a black convertible top whose color would remain 
virtually unchanged throughout its life. 

Another example is the improvement on woven plastic (”Saran") 
body fabric as a partial result of the Ford-Dow technical meetings. 

Some of the improvements were light stability, shrinkage resistance, 
reduction of static electricity, improved color range, etc. 

In summation, the Automotive Industries and the fabric suppliers 
are primarily interested in assuring that the fabrics will be satis- 
factory to the consumer. To fulfill our obligation to the consumer, 
it is of utmost importance that adequate control be maintained on the 
quality requirements we have just discussed, and on the other quality 
requisites not specifically presented in this paper. 
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QUALITY CONTROL'S OBLIGATION TO 
MANAGEMEOT MD CUSTOMER ON RELIABILITY 

Colonel Clair A. Peterson 


I have been asked to present my views on the subject .of Quality 
Control's obligation to management and the customer on reliabi^^^^ of 
comp3.ex equipment. 

To state the case in simple brief terms, it is the obligation of 
Quality Control to assure management that the products for which 
management is' contractually committed to furnish to its customer are in 
fact in accordance with the specified requirements. 

This job of having to assiire quality and reliability of the 'product 
places the quality control manager in the position of having to:: be 
concerned with all the functions and activities of the coiiTpany ^hich, in 
one way or another, have a besuc^ing on the quality of the final product. 

Furthermore, with the introduction of specific reliability require- 
ments; the function of quality control becomes more wid.e spread than 
heretofore. It is now necessary that the quality manager be directly 
concerned with the proving-out phase, as well as the in-service;' usage of 
the equipment. 

This necessitates the establishment of a working relationship with 
the customer, so that operational performance can be closely followed 
and quality control problems quickly resolved. 

Because of the important function of quality control in a relia- 
bility program, it is also necessary that the quantity control manager 
participate in the negotiation and proposal process of contracting; so 
that all pertinent aspects of the contract and specifications aii*e 
properly considered and provided for in the proposal. 

Likewise, it is necessary that the quality control manager parti- 
cipate in the program for subcontracting and source selection, ;; it ,is 
also necessary that he maintain, at least during the initial stage of 
production, an active liaison with those suppliers furnishing the more 
important Items of equipment. 

In the brief period of time allotted to me, it is not possible to 
cover all aspects of the quality control function. I can merely high- 
light some of the particular activities of quality control in carrying 
out its obligation to management and the customer. 

We know that as We progress further into the concept of the weapon 
system, the role of the quality control manager becomes more and more 
diversified - extending his interests into outlying areas, and geogra- 
phic locations remote from the manufacturing facility. 

Under these new concepts, both the contractor and quality control 
continue to have certain obligations to the customer - even after the 
equipment has been accepted and placed in service. 
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"EVALUATING THE VENDOR’ 


W.A. MaoCrehan, Jr* 

Bendix Radio Division 
Bond ix Aviation Corporation 

Vendor Quality Evaluation operates in four basic areas in n^hich 
management activity, through Quality Control, is yielding dollar^ 
dends and customer assurance* 

The first is a basic understanding of the concept of variances* All 
products will not be alike. The degree of allowable differenoe;;that ex- 
ists between one unit of a production run and another unit from the pro- 
duction run is controlled by the ongineer through permissable variations, 
called specification tolerances* The desired dimension, or value, or 
characteristic of the design is called the nominal. Because of 'normal 
variances, as well as assignable cause of variances, the hominaj charac- 
teristic will not be present in each unit of production* Consecjuently, 
the control of this variance to parameter within the specif icati^^^ 
erances is the heart of good Receiving Inspection **• therefore,^ raw ma- 
terial, and components controlled to insure that the design intent of 
product variances is being maintained, is a beginning of dimensional con- 
trol of the vendor's product. At this point, to evaluate perfomance of 
the vendor it is necessary to establish some sort of "box score**:, a scale 
from zero to one himdred **• a direct listing of the estimated peroehtage 
defective fomd in sampling the product when received or a weighted char- 
acteristic ranking method; all are practical operations to evaluate the 
ability of the vendor to perform within the requirement of the apecifioa- 
tion* 

A second basic obnoept is an understanding that three factors oper- 
ate vdien a product is purchased **. price, delivery, and quality. De- 
pending on the market availability, depending on the supply and Idenm 
the particular product, and depending on competition among vendors, these 
three characteristics will vary In their importance. However, It is not 
good management to purchase on the basis of purely price and delivery, 
and a prime point of evaluating the vendor is to secure the whole-hearted 
cooperation of Purchasing in considering the factor of quality oh an 
equal level with price and delivery when making purchasing considera- 
tions, 

A third important concept is the knowledge of the error of sampling. 
Small samples taken from large lots yield a minimum of assurance* The 
error is not in the statistioal saiapling theory *** it lies in the lack 
of knowledge that the nijmber of samples on Ydiioh one bases an eltimate is 
proportional to the assurance you desire that the decision you have 
reached is valid* Past history has indicated many case example | of suc- 
cessful non- statistical "ten percent of the lot" sampling plans that 
work* However, for every instance on record where "rule of thumb" non- 
statistioal guessing is used, there are many more which show such a fixed 
plan Is not good management because of the instability of the risk taken 
on insecure knowledge of the true ratio of good pieces to bad in the en- 
tire lot* Therefore, the sliding scale that ratios sample size to lot 
size used by modern sampling tables, such as Dodge-Romig, Mil Std. 105A, 
or various sequential sampling plans, is based on a known desire: of con- 
fidence in the estimated percentage defeotive obtained through tlhe ratio 
of good pieces to bad in the sampled lot* Further progressive thinking, 
such as continuous sampling plans used by Bell Laboratories and ’Navy Ord- 
nance, utilizes this knowledge of sampling variances that the estimated 
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percentage defective is accurate within certain confidence parameters as 
justification to reduce the cost of inspection and test at Incoming In- 
spection and on the production line* 

A fourth vital concept is a basic belief that all vendors would like 
to do a good job of supplying their customers ••• and with the belief in 
this axiom« a desire by the customer to assist the vendor through an edu- 
cation program of histograms^ simple running control charts and Lot Plot 
techniques invariably return good results of mutual benefit to both the 
vendor and the customer* 

SUMMARY t All control is inherently based on the "cost of confor- 
mance versus the cost of control"* To establish a quality evaluation 
program for vendor items takes an initial expense in these areas: people 
to make a preliminary survey of the vendor’s facilities; people to audit 
the methods by which good or bad quality is determined at Receiving or 
Line Inspection; third* people to liaison between the vendor* the Pur- 
chasing Department eoid individuals concerned with the vendor’s product 
quality on the assembly lines; and people to evaluate and instigate cor- 
reotive action idiere your evaluation indicates unsatisfactory perfor- 
manee* Depending on the size of the organisation* this could be a single 
person doing a multiple of these duties* or a specialist of proper tech- 
nical background to cover each* The experience of many companies that 
operate an agressive vendor rating program has oonsistently shown it to 
be good management to invest quality dollars in this area of activity* 

Control of variances present in a process can be quickly summarised 
into two categories: those variances that are known* and those variances 
that are imknown* The conditions causing known variances are usually 
corrected rapidly and with little investigation* Where variances are un- 
known as to their cause* statistioal quality control methods through 
trend charts, process capability charts* Lot Plots* and similar techni- 
ques* spotlight the offending causes of variances with a minimum of time 
and effort* 

Evaluating the vendor is a method by which you can separate the 
knowns from the unknowns and instigate corrective action to whatever de- 
gree seems to be necessary* based on the managerial evaluation of the 
weight of the problem in terms of delays to production* exoess scrap and 
rework, and obsolescence or deterioration through exoess inventory* All 
of these problems are faced daily and most firms either use a high vol- 
ume of raw material that they complete into finished p;oods or bty multi- 
ple components for assembly into finished products* Therefore, a certain 
percentage of all end product quality is in the hands of your suppliers* • 
*• it is good management to control this element of your end product qua- 
lity* 
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QUALITY CONTROL OF VISUAL CHA^R/lCTEIgSTICS 

C. W. Carter 
Rath St Strong, Inc# 

Boston, Massachusetts ' 

The most widely used of all sensing instrum^ts is the himiian eye# 
By definition, then, a visual characteristic is any that may be sens^ 
by eyesight • Thi s would embrace all laeasurihg ihst lumerits of 0ge 
readings, and here a distinction must be made# 

That distinction will be between Mlmensional" control and; the 
control of visual characteristics# Considering dimensional control in 
its broadest sense, then, one should include all characteristics 
may be gaged with some physical instrument and whose results are read- 
ily expressed in numerical texnos# Examples of testing instruments for 
the control of dimensional characteristics range from a weighinjg scale 
to a temperature thermometer; from a micrometer to an ammeter; from a 
hardness tester to a pH indicator, and so forth# 

Industries in idiich the control of quality is a matter of meeting 
a dimensional requirement are many# It is in this area that statis- 
tical quality control made its start and has effected its largest coiv** 
tribution# This would include attribute inspection, for therein the 
results are readily expressed in nuiber^^ i#e# good = Q, bad » 1; and 
the percent defective is the measure of quality# 

Visual characteristics, by contrast, may be considered as those 
appearance considerations which make the difference between satisfac- 
tory and unsatisfactory product# These may consist of specific defects, 
such as scratches, or dents; they may comprise the overall ♦'looks** of 
a product, such as a fabric, or a television set# In either cape, the 
quality could ha ^ly be measured by conventional means # For escairrple, 
it would be difficult to imagine ah ih^ of compietely 

describing the quality of a scratch. 

The control problem usually arises from manufacturing the ■p«)duct 
to dimensional specifications while selling it oh the basis of -ytsual 
characteristics# Experience indicates that this is a fairly universal 
problem; equally - and in some cases more - important than dimensional 
control# It is our opinion that much more attention should be given 
to this important phase of quality control. 

It is the purpose of this paper to suggest that practical as well 
as statistically sound approaches can be successfully utilized jbo con- 
trol the appeai^nce quality of a product# 

The general approach to any control problem may logically follow 
these four steps: 

1# Determine the process capabilities 

2# Eliminate or reduce pilncipal sources of variation ' 

3# Design an adequate control routine 
U# Provide proper maintenance# 

This paper will touch principally upon the first of these 'since 
it Is probably the most difficult# 
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In order to define the process capabilities, one must be able to 
measure the quality characteristic under consideration* Hlfhat sets this 
subject apart from the usual control problem is that herein we are pre- 
sented with unusual measurement challenges* 

Let us consider four specific solutions to measurement problems 
involving visual characteristics; 

First, it may be possible to devise an instrument which will 
measure the particular characteristic# One such example is the pro- 
filometer, which measures metallic finishes by averaging the surface 
roughness. Another example is the spectrophotometer, measuring color 
and expressing it in terms of tri-stimulus values — and so on. 

Secondly, product specimens have been established as visual qual- 
ity standards. These serve as inspection guides to the acceptable 
limit of appearance quality. This may then be handled on an attribute 
basis, and the quality level expressed as a percent defective. TlVhere 
it is infeasible to transport the actual samples, 3-D picttires are 
sometimes employed. For instance, the Quarteimaster Corps developed 
such a booklet showing allowable and not-allowable examples of a rather 
complete line of fabric defects. 

The third solution is useful in instances where it is possible to 
isolate and study a particular visual defect by itself. This starts 
with the definition of a few innate descriptive categories within which 
the defect may be fully classified* 

For example, it was desired to reduce the occurrence of dents in 
the manufacture of coffee percolators. The four descriptive categories 
selected were; 


1. Location 

2. Size 

3. Source 

U* Style* 

Figure 1 shows the numerical assignments made to these four cate- 
gories. By use of these numbers, then, any dent could be adequately 
described. Since each category was independent of the others, a total 
of 8x3x2x2 or 96 nomerical combinations were possible; 1111, 1112, 

1121, 1122, and so on through 8322. 

If the dents were caused by purely chance reasons, each combination 
or kind of dent, would have an equal likelihood of occurrence. Out of, 

500 dents observed there would be about it-6 of each kind. However, 
if the distribution of dents wei*e significantly different from the ex- 
pected, - if there were any pronounced concentrations - some systematic 
assignable cause would be at work. Further, the nature of this cause 
might be indicated by the particular kind of frequently-occurring dent. 

In order to get this picture, as well as the occurrence by opera- 
tion a random-time-sampling was set up after the seven principal opera- 
tions. Five percolators were carefully examined on each visit, and any 
observed dents were classified. The Audit Classification Work Sheet 
used in this study is shown in Figure 2. Following a period of approx- 
imately one month the classification data was summarized for the various 
sampling points. 
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The result^ appear in Figure 3 * From this information, it jirae 
possible to cietail the relative contribution of the several areas* 

This is illustrated graphically in Figure U* 

The last solution is the utilization of opinion-ratings as a means 
of describing the overall visual quality of the product# This if|as sug- 
gested by two successful applications of subjective judgments in dis- 
cerning differences in taste# One of these was at IfiLlbu^ 
the control of chpcola.te quality^ the other at the Schenley Distiiler- 
ies in the blending of whiskey# The plan developed and practiced at 
the Bigelow-Sanford Carpet Company is an exipellent illustration of 
this technique# 

A more recent example is its application to the controlling of 
Acoustical Tile quality* 

Here, three principal appearance categories were establish|d: 



1* Machine Base Board Machine 

2* Coating Coaters 

3 m Fabrication Finishing (inc# cutting, drilling, 

bwelllh^ etc*) 

As shown, each category relates directly to a particular ojperation 
in the manufacturing process* Each is relatively independent of the 
other* Thus, each category may be rated, according to ah Inspector's 
judgment, practicalty without reference to the other two# j 

The point at which this inspection is done is the final sorting 
tables* Handoa^time-schedules, based upon the 96 ^-minute periods in 
an 8-hour workday, were developed for the Inspector# At each sjbrting 
station, he sainples five tiles each from the ciai pile and the 
product stack# Each tile is then rated in each of the three categories, 
using the following schedule of rating nuinberst " 



1 Incidental 


2 Minor 

3 Major 

h Critical 

The sum of the tto gives the total quality rating for 

that tile# 

Following an introductoiy, or familiarization period, a base period 
of one month served to establish (a) the process capability, and (b) the 
consistency of the Inspector’s rating# During this period, samples were 
taken of the production cpmJLng to the sorter as well as the 
good following sorting# Although different samples were selectecJ for 
the ’’before” and wafter” ratings, it was assumed that tihey came from the 
same population# The accepted tile ratings and the cnllM t^^ 
ware combined in the saie^^r^ as the overall percent perfect and culls 
from Production records# fKis'gave a ptediction of the quality rating 
of tile cbmirig to ile terter, which was then compared with the , actual# (2) 
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Figure 5 shows this comparison# Since these were sufficiently 
similar, the **saiae population” assumption could be justified, and the 
consistency of the Inspector's rating iras established* 

This distribution of total quality ratings p3x>Yided the gage as to 
the process capability for the base period# The average of the highest 
rating for each tile gives the quality level for that period* Thus the 
visual quality for the operation may be compared, as time passes, to 
show changes in the process* 

A representative ”control panel” of 100 tiles was selected and 
therewith the Inspector periodically ”calibrates” his judgment# Furtheij 
this control was submitted to several customers for their rating# With 
two startling exceptions (in one case, the customer was more severe, in 
the other, less 1), the results were very comparable# The Inspector’s 
ratings were then adjusted to reflect these differences* 

Another phase is evaluating the relative contribution of the sev- 
eral defects making up the quality problem# With each rating of 2 or 
greater, the Inspector must list the defect involved# The frequencies 
of each defect are then tabulated, and this serves as a continuing guide 
to production personnel for current and effective defect prevention# 

Using the highest rating for each tile, considering 3 and 1* to be 
imperfect, the quality balance for the sorting operation may then be 
deteimined* Initially, this appeared as pictured in Figure 6# 

That this control has made a positive contribution to quality 
improvement may be seen from the following table: 

Base After 

Item Period Six Months 


Percent Culls to Sorters 

m % 

12 % 

Percent Culls to Inventory 

s% 

3 % 

Percent Good in Culls 

2k % 

8 i 

Average Rating 

1.7 

1.5 


Perhaps the most immediate contribution was in the area of reducing 
the occurrence of good product in the cull pile* This was not accom- 
plished at the expense of the outgoing quality level, and there is 
definite indication of an improvement in the visual quality of tile sub- 
mitted to the sorters* 

In conclusion, then, the quality control of visual characteristics 
may be accomplished in at least four manners: 

1# Devise a measuring instrument 
2* Establish comparison standards 
3# Isolate a particular visual defect and 
describe It in quantitative terms 
U* Utilize opinions as a means of rating 
the overall product quality# 

Among these proven techniques, there should be one or a combination 
thereof to which your visual quality problem will yield* Only your 
application will really demonstrate how effective they can be* 
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(1) "Quality Control of Visual Chara.cteilstips'’, by Stanl^ E, 
Lezinski, I.Q.C., July 1953 • 

(2) These were coa^ared using the technique* 
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P3RC0IAT0R DEWT STUDY 


Instruction Sheet 


For the Glassification of Dents 


Without tracing its reason, one can numerically classify a dent 
according to four characteristics; 

(1) Location on the Percolator 

(2) Size of the dent 

(3) Source 

(4) Style 

In order to conveniently analyze these data, the following code is 

used: 


1. LOCATION ; 

Looking at the percolator from on top; 

It is then divided into two horizontal sections 
and four cross-sections; thus, a dent located on the 
top half just to the right of the spout would be 
classified as §1 under the characteristic ’’Location", 

2, SIZE OF DENT ; 

The longest dimension of the dent is the basis 
for classification of this characteristic: 


Spout 



SIZE OF LONGEST DIMENSION 


CLASSIFICATION NUMBER 


Under 1/4" 

Between 1/4" and 1" 
Over 1" 


1 

2 

3 


3 . SOURCE ; 


CLASSIFICATION NUMBER 


’’Outside - In" 
"Inside - Out” 


1 

2 


4. STYI£; 


CLASSIFICATION NUMBER 


Sharp (either line or point) 1 

Rolling 2 
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PER CSMT OF PRODUCTICW DEMTED 


PERCOUTOR DENT STUDY 


Graph Showing Relative 
Contribution of Five Principal Areas 



AREA NUMBER 
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inSUAL RATI^TG CONTROL 
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SELECTION ANI) MNKIIfG 

Shantl S. Gupta, Marilyn J. Huyett and Milton Spbel 
Bell Telephone Laboratories 

1 . Introduction . 

This paper deals with three problems concerned yitb the^r^ of 
two or more binomial populations. In all the problems the goal is to 
find the best, define the best population 

to be the one with probability p of a success on a single 

trial. In the first problem the goal is to find the number of obser- 
vations required to guarantee with probability P* that the largest 
proportion of successes comes best population when a certain 

indlfference-zpne condition holds,. , In the second problem the goal is 
(for any given number of observations) to select, a subset of the h, 
given populations for which we can assert with probability P* t^t the 
best population is contained therein. We would like a prdcedurl which 
makes the hiunber' of. p^^ in the retained subset small, aM at the 

same time large enough to satisfy the P* -probability condition ^iven 
above. In the third problem the goal is (for any given, number Qf obser- 
vations) to select a subset of the k., given populations for which we can' 
assert with probability P* that all populations better than a given 
standard or control are contained therein . 

The normal counterpart of problem I is treated by Bechhofe?* in 
[l]. The normal counterpart of problem II i s treated by Gupta in [ 3 ] . 

A different treatment of the normal counte of problem III Is given 

by Dunnett in [2]. Earlier, Pauison [6] considered for the normal and 
binomial cases the problem of selecting the best one of k categories (or 
populations) when one of the k populations is regarded as a ste^^dard or 
control. Paulson/s and punnett’s procedures both guarantee a probabili- 
ty P* of selecting the standard as best when all the populations have 

equal pareuneter values j in the procedures givSTblSow, a^% 
definition is given for a correct decision .and„. a probabili P* of a 
correct decision iS guaranteed for all possible true configurations of 
the unknown parameter values . Applications are given in all 0^; these 
papers. Any binoidal or^g^^^^ which it is deslrep, .to ..sift 

out the better processes or eliminate the poorer ones is a potential 
appli cati on of the problems treated in thl e pap cr . Many appli cations 
are not .immediately apparent. For example, if units from several ^d^^ 
ent manufacturing processes are put on a life, test, the experimenter may 
wish to find the process which produces the most reliable unit,.,. If he 
defines a unit tp be good (i.e. a success) if it performs satisfactorily 
for a certain number of hours and to be poor (i.e. a failure) othei^ise, 
then the binomial . framework is. applicable . ;i.: 1 

The corresponding problems for selecting the population with the 
smaller or smallest value of p are mathematically equivalent tp- the 
problems treated here and the same tables ar^^ usually applicable. 

In problems II and III the formulation is more flexible in that the 
esjperimenter can select, a subset ;a^ withhold Judgment about which, is. 
the best one. Then the experimenter (or his boss) may wish to select 
one from . thi.s.. .subset., .o.n .the. .ba.si..s..,..^.pf eco.npiy.c or. ^pt.her consld^^ 

It should be noted that , in selecting a subset containing the besb "popu- 
lation we are automatically eliminating distinctly inferior populations 
so that these procedures may be regarded as elimination or screening 
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procedures. 

2 . Problem I. 


Associated with each of the k given binomial populations there is 
an unknown probability p of success on a single trial, LetS*0 denote 
the true (but unknown) difference between the largest p and the second 
largest p for the k given populations; for simplicity^ we assume that 
The goal of the e:3q)erimenter is to select one of the given popu- 
lations and assert that it has the largest p-value. If the popiiLation 
with the largest p-value is chosen then the selection is defined to be a 
correct selection. Before the experiment is performed the experimenter 

specifies two numbers (6*, P*) with b^O and i<P*<l, and states that he 

requires a procedure which guarantees a probability P* of a correct se- 
lection whenever the true difference 5 is greater than or equal to 6*. 

The above requirement may be regarded as an indifference -zone con- 
dition since, roughly speaking, it states that the experimenter is 
willing to relax his probability requirement if the "error" is going to 
be one of selecting a population whose p-value differs from the largest 
p by less than the specified value 6*. 

Formally, we can define a selection as a correct decision if the 
selected population has a p-value which differs from the largest p by 
6* or less. Then the given procedure guarantees a probability P* of a 
correct decision regardless of the true configuration of the unknown 
parameter values . 

Procedure 


The procedure will, of course, be to select as best the process 
which gives the highest proportion or nimiber of successes; the onl^ re- 
maining problem is to determine the common number n of observations re- 
quired per population to satisfy the indifference -zone condition. 

Table I gives the required number n for selected values of 5* and P*; a 
more complete set of tables with an explanation of their construction 
can be found in [ 7 ] . 

If there are ties for first place among the sample proportions of 
successes the experimenter may decide between contenders for first place 
by a chance experiment with equally probable alternatives. However, 
even if the experimenter wishes to use economic or other considerations 
to decide between contenders for first place, it appears reasonable in 
most problems to use Table I without any change. If the experimenter 
recommends all the contenders for first place and he is satisfied if one 
of them is the best one, then the values in Table I can be reduced by an 
amount equal to the largest integer in (l/5^), 

A more complete write-up on this formulation of the problem to- 
gether with another formulation which attempts to make use of a priori 
information is given in [ 7 ]* 

3* Problem II . 

In this problem the number of observations is assumed to be given. 
Befo re or after the experiment is performed the experimenter specifies 
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one nyjQiber P* with i<P’>KL and states that M r a procedure for 

selecting a subset of the k populations which guarantees with probability 
P* that the best population is contained in tM selected It is 

desirable to have a e^bset which is ' small and^ at the sane time/ large 

enough to satisfy the above condition. It -should be noted that /there is 
no indifference -zone involved in the above requirement. We are ^assuming, 
for simplicity, that 5X) as in problem I so that the best population is 
uniquely defined. 

If we define the selection of any subset containing the best popu- 
lation as a correct decision , then the proposed procedure guarantees a 
probability of a correct decision of at least P^ regardless of the true 
configuration of the parameter values . If and if we define Hhe se- 
lection: of a subset to be a correct decision if it contains at least one 
population with a largest p-value, then the proposed procedure still 
possesses the same property. 

We consider two procedures for this problem; one is exact in the 
sense that it involves binomial theory, and the other is approximate in 
the sense that it employs an arc sine transformatipn and makes Use of 
the normal approximation to the binomial. In the first case th| number 
of obseryatipns is assOTed to be the same for each population; in the 
second base this asstui^^ is not made. Ihe first procedure satisfies 
the requirement for all possible configurations but is more conservative 
and in most case^ ^ subset as large or larger than that required 

by the second procedure; the second procedure has a probability of a 
correct decisipn whiph.,...fpr G,erta.i^^ small yal^^ 

able configurations will dip below the specified value P* due to the in- 
accuracy of the normal approximation for small n. Even for the.; worst 

cases when there i s a common p , thl s curve flattens put and approaches 

P* throughout the open interval, 0<p<l, as n grows large. 

The joint confidence statement that can be made after experimen- 
tation wj^ confidence. PjJ; is that the parameter value of each eliminated 
population is less than that of the best population . It Is shojm in [ 3 I 
that for the hoiS case other t^bs of Joliit confidence statem^ts can 
be made in place of that given above. 

Procedure IXA 


"Let x^ denote the number of successes ob§er^^ n obser- 

vations from the i^^ population (1 = 1,2, . . .,k) and let x denote the 

■til IDSX 

maximum of these k integers . Retain the 1 population in the J^elected 
subset if x^ falls in the closed interval , . L 


(1) 


d, X 


max 


where d is given in Table IIA. as a function of P* and n. " 


ProcedurellB 


"Make the arc sine transformation 


(2) 


I 


arc sin 



I n^+1 


+ arc sin 



x^+i* 


ni+l 


637 



th 


and let z denote the maximum of these niMhers. Retain the i 

max 

lation in the selected subset if falls in the closed interval 


popu- 


(3) 


z - d, z 
max max 


where d is given in Table IIB as a function of k and P* only.” 


For more complete fomns of Table Ilk and Table IIB the reader is 
referred to [5] and [3]^ respectively. 

4. Problem III . 

This problem is similar to problem II, the main difference being 
that one of the k populations is regarded as a standard or control and 
the others are compared with the standard. Before or after the experi- 
ment is performed the experimenter specifies one number P* with 

1/2 ’’■^<P*<1 and states that he requires a procedure for selecting a 
subset which guarantees with probability P* that all the populations as 
good as or better than the control are contained in the selected subset. 


If we define the selection of any subset containing all populations 
as good as or better than the standard as a correct decision, then the 
proposed procedure guarantees a probability of a correct decision of at 
least P* regardless of the true configuration of the parameter values . 

The joint confidence statement that can be made after experimen- 
tation with confidence P* is that the parameter value of each eliminated 
popifLatlon is less than that of the standard . 

yJe consider two cases according as the parameter value of the 
standard p^ is known or unknown. 

Procedxu'e IIIA (Known Standard) 

"Let X denote the number of successes observed in n observations 
from the i^^ population. Retain the i population if 






Po (l-P^) 


Ni 


where d remains to be determined. If we let M. denote the smallest 
integer greater than or equal to 

(5) “i = Vo ■ ’ 

then the riile (if) can he written in the simpler forp 


( 6 ) 


Xi%Mi 


For the special case n^ = n (i = l,2,..,k-l) we have = M and the 
common value of M is given in Table IIIA for selected values of p^, k, 
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P* and some smaXl Y^ues of^n values of (not necessarily 

equal) the value of d to he used with (^4-) can be conveniently obtained 
by the relation 

(7) PCd) = 

where F(d) denotes the probability that a standard normal chance -yari- 
able is less than d* Thus_d easily obtained with the help of any 
table of the integral of the normal distribution. 


Procedure IIIB«"1 (Unknown Standard) 

"Retain the i^^ population (i = l,2,...,k-l) if the number of 
observed successes in n^ obseirat ions satisfies the inequality 


(8) 


X. X 

J:>^ 

^i 


d^ 

2 


M 


1 1 

n> n 
i o 


where the subscript zero refers to the standard population and d , re- 
mains to be detemined. " 


For the special case n.» n (i * l,2,..,k-l) the rule (8) takes the 
simpler form 

(9) - d 

where d is given in Table IIA as a function of k, n and P*. In the 
more general case if the n^ are large and not necessarily equal, it is 

possible to use the following approximate procedure. 


Procedure IIIB-2 

"Let be defined as in (2). Retain the i population if 

( 10 ) 

where d is given in Table IIB as a function of k and P* only." 
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TABLE I 


Minajamm number of oLservations required per process to 
guarantee a probability px- of a correct selection when the true 
difference 5 is at least The four values in each cell correspond 

to the probability levels = ,80^ . 90 , .95^ *99 f respectively. 


"\d* 

k 

.05 

.10 

.15 

.20 

.30 

.40 

.50 

2 

142 

36 

16 

9 

4 

3 

2 


329 

83 

37 

21 

9 

5 

4 


54 i 

135 

60 

34 

15 

9 

5 


1082 

270 

120 

67 

29 

16 

10 

3 

273 

69 

31 

17 

8 

5 

3 


498 

125 

55 

31 

14 

8 

5 


735 

184 

82 

46 

20 

11 

7 


1308 

327 

145 

81 

35 

20 

12 

4 

359 

90 

40 

23 

10 

6 

4 


601 

150 

67 

38 

17 

9 

6 


850 

212 

94 

53 

23 

13 

8 


1442 

360 

160 

89 

39 

21 

13 

10 

606 

151 

67 

38 

17 

10 

6 


890 

222 

98 

55 

24 

13 

9 


1169 

291 

129 

72 

32 

17 

n 


1803 

kk 9 

198 

in 

48 

26 

16 
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tabu: iia 


Values of d for Procedures IIA and IIIB-1 to be used ¥he|’e ther 

1 s a cpBXEnpj:; xx};^eT., n , of , p‘b,servati.,WS. C .each, ,of . ,k^ populations . The 

two values in each cell correspond to the probability levels = .90 
and *95/ ^respectively. .i 


"\k 

2 

5 

10 

15 

20 

25 

30 

4o 

50 

5 

2 

3 

3 

3 

4 

4 

4 

4 

4 


3 

3 

4 

4 

4 

4 

4 


5 

10 

3 

4 

5 

5 

5 

5 

5 

6 

6 


4 

5 

5 

6 

6 

6 

6 

6 

6 

15 

4 

5 

6 

6 

6 

7 

7 

■ I 

7 


5 

6 

7 

7 

7 

7 

8 


8 

20 

4 

6 

7 

7 

7 

8 

8 

'.8 

8 


5 

7 

8 

8 

8 

8 

9 


9 

25 

5 

6 

7 

8 

8 

8 

9 


9 


6 

8 

8 

9 

9 

9 

10 

lip 

10 

30 

5 

7 

8 

9 

9 

9 

9 

ID 

10 


6 

8 

9 

10 

10 

10 

11 

ll 

11 

35 

5 

8 

9 

9 

10 

10 

10 

11 

11 


7 

9 

10 

11 

11 

11 

11 


12 

40 

6 

8 

9 

10 

10 

11 

11 . 

.'.ll . 

12 


7 

10 

11 

11 

12 

12 

12 

13 

13 

45 

6 

9 

10 

11 

11 

11 

12 

ik 

12 


8 

10 

11 

12 

12 

^3 

13 


14 

50 

6 

9 

11 

11 

12 

12 

12 

13 

13 


8 

11 

12 

13 

13 

13 

14 

i4 

l4 


TABLE IIB 


Values of d for Procedures IIB and IIIB-2 to be used when the 
numbers n^ of observations are large for each of the k populations. 


k 

P*\^ 

2 

5 

10 

15 

20 

25 

30 

40 

50 

.75 

0.95 

1.85' 

2.26 

2.47 

2.60 

2.70 

2.78 


2.98 

• 90 

l,8l 

2.60 

2.98 

3.17 

3-30 

3-39 

3.46 

3.58 

3.66 

•95 

2-33 

3.06 

3-42 

3.60 

3-72 

3.81 

3.88 

3. $9 

4.07 

•99 

3-29 

3-92 

4.25 

4.41 

4.52 

4.61 

4.67 

4.77 

4.85 
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TABLE IIIA 


Smallest integer value M required for Procedure IIIA for selected 
values of p , k and ?*• The three values in each cell correspond to 

k = 2, 3 and respectively. 
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QUALITY CONTROL IN THE CARTON PLANT 
D, R, Carlson 

The Gardner Roard and Carton Co. 

What is Quality? 

Quality is the conformance to functional and aesthetic 
standards for which a price has been agreed upon and con- 
tracted with the customer. 


What is Quality Control? 

Quality Control is the sum total of all methods used to 
attain quality. 

What is Statistical Quality Control? 

Statistical Quality Control is a systematic procedure 
under which random and representative raw data is gathered 
and analyzed to determine whether all or any part of such 
data is drawn from within or without a chance cause System. 
Such analysis to result in conclusions based on predeter- 
mined levels of confidence and probability. The intelligent 
interpretation of these conclusions aid the identification 
of the when ^ where and frequently how of the assignable 
causes resulting in departure from the desired chance cause 
system as well as a better understanding of process Cap- 
abilities. 

Why Quality Control at Gardner's? 

1, To help make production of quality as easy as 
possible- 

2. To help provide incentives to people to do good 

work. 

3- To help protect the customers^ interests in; our 
plants. 

4- To deliver production news - not history - and 
facts not opinions - to operating crews. 

5- To supply facts to operating management by: 

a. Measuring the adherence to or deviation from 
specifications. 

b. Establishing procedures for rapid feeC-back 
of information to operating people to; aid the 
decision making process on which control is 
based, 

c. Analyzing whether measured deviationsiare 
those which can be considered due to ‘Chan ce 
causes or possible assignable causes iwhich 
should be investigated, isolated, elijininated 
or made a permanent part of the process. 

d. Indicating the degree to which raw or semi- 

finished raaterials fail to meet specifica- 
tions so that they can be segregated for 
special handling. !■ 

e. Summarizing inspection data and reporting 
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periodically to operating management so that 
long range process trends can be detected. 

6, To help determine the characteristics which reflect 
desired performance of the finished product. 

7- To aid in the establishment of specifications. 

8. To help establish test methods which can measure 
whether specifications are being met. 

9. To help determine process capabilities. 

10. To aid technical people in data analysis and design 
of experiments. 

What Limits the Application of Quality Control Techniques? 

Quality Control techniques can be applied under any 
circumstance where data can be gathered. Quality Control 
requires only that a quality characteristic^ a condition, or 
a set of circumstances be identified and measurable, whether 
objectively or subjectively, to be subject to control pro- 
cedures. 

Philosophy of Quality Control at Gardner 

Quality Control to function adequately and develop must 
have the support of all levels of management. 

Quality Control is a staff department and functions in 
an advisory capacity. Quality Control does not directly 
stop machines, processes or reject material. 

The direct responsibility for quality lies with Pro- 
duction. 

The Quality Control Department shall be completely 
independent from production and function as an internal 
auditor of quality. 

The Quality Control system is a friend of the workman 
and not a monitor over him. 

Quality Control shall evaluate each and all samples as 
if they represented 100^ of production. Failure to meet 
specifications must be reported without bias. 

The basis on which finished product is shipped may not 
always be consistent- Normal shipping requirements may be 
affected by customer's immediate need for cartons, unusual 
operating problems, agreed upon price changes with customer, 
etc. Quality measurement standards, must, however, remain 
consistent. A constant reference base is necessary so that 
changes can be detected hot only in the quality level but in 
the customer's attitude toward quality characteristics. 

Quality Control in the Printing Plant 

The problem of establishing a quality control system 
has two main factors. One is insuring that the techniques 
of measurement and analysis are both accurate and valid. 
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The other factor is the practical difficulty of selling a 
program which contains inherently some unpopular character- 
istics. In the following discussion^ time and space permit 
only a few of the techniques which are used for quality 
control and analysis. Some of the industrial relations 
problems will also be discussed. Much has yet to be- done to 
completely sell people on a program which they got along 
without for years. There is objection to a system which 
insists on publicizing (for all to see) a man^s mistakes 
even though it also publicizes (for the same audiencp) his 
good work, 

In-Process Inspection - Printing 

A printed sheet is selected at random at least once an 
hour from each press. This sample sheet is taken to the 
inspectors^ Quality Control station and placed on a islant 
top table with a standard light. The sheet is inspected 
carton by carton. The basic inspection unit is the carton. 
Defective areas on the cartons are circled and identified. 
Defects are classified into three categories of severity. 

To each of these categories is assigned demerits or severity 
points. These severity classifications are defined Its: 

Minor - Minor defects by definition will always' be 
accepted by the customer. In our minds, however, it 
is a defect and should become part of the defec|-ive 
quality record. One severity point is assigned to 
this classification. 

Major - Major defects are worse than a minor (just 
noticeable) defect, but are not serious enough to 
reject the carton. There should not be too many. 

To this classification is assigned three severity 
points. 

Critical « Critical defects by definition cause the 
carton to be rejected. To this classification is 
assigned six severity points. 

Despite these definitions, the cumulative effecii of 
several lesser defects on a carton have an adverse affect 
beyond the explicit meaning of the definition. That is, 
three minor defects on the same carton will usually result 
in as much concern as the presence of a single major: defect. 
Six minor defects or two major defects dn the same c|irtpn 
will generate nearly as much action as a single rejeOtable 
critical defect. 

By definition a given defect can dbOur only oncp on a 
carton and is evaluated with the severity of Its cumulative 
effect. 

Because the pressroom has traditionally been the domain 
of men, Quality Cdntrol at Gardner was first set up so that. 
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if necessary, the inspection function could have been car- 
ried out by a deaf mute. Fortunately, it has never been 
necessary to prove this- Information is communicated to the 
pressmen in four different ways - 

1, The Daily Control Chart 


The plotted point for each test is the average number 
of severity points per carton on the sheet- Also on the 
chart appears the type of defect, its severity and the die 
position on which it was found- 

2, Signals 

On the back of each control chart board there ar*e a red 
hand, a yellow hand and a green ball- When a #6 (critical 
defect) has been found on the sheet, the red hand goes up. 

If no more than a #3 (major defect) was found the yellow 
hand goes up. If no more than minor (#1) defects are found, 
the green ball stays up. The presence of both the red hand 
and the green ball indicates to the production foreman that 
at the last inspection a critical defect was found by the 
inspector and that the pressman had taken corrective action. 

The red hand alone indicates to the production foreman 
that a critical defect was found by the inspector and that 
the condition has not yet been corrected. Fixed or not, the 
colored hand stays up until the following test when the 
quality situation is revaluated. 

3. Exhibit 

The inspected sheet on which all defects are located 
and identified is returned to the press table- 

4- Personal 


The presence of a critical defect on a sample sheet is 
made known verbally and immediately to the pressmen- 

There are a series of four integrated charts which use 
the same basic statistic (SP/c). These charts help us keep 
a finger on the pulse of quality variation from individual 
test to job average and from hourly fluctuation to yearly 
variation. Before we discuss these, however, there are a 
few factors which should be considered. 

It is desired that the plotted points on the daily con- 
trol chart reflect those things for which the pressman is 
responsible and accountable- However, there are times when 
the pressman is instructed to run with marginal materials or 
until the end of a feeder load or with a condition which 
cost factors indicate need not be completely eliminated. 
Defects occuring under those conditions are, therefore, not 
the direct responsibility of the pressman. Inspection and 
the quality record, however, go on. For this reason the 
foreman's okay section was added to the daily control chart. 
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When a situation like that described above occijirs^ the 
pressman goes to his foreman and gets an okay. The occur- 
rence of that defect, thereafter, results in the defect be- 
ing charged to the foreman's section of the chart- The 
graph line then continues to reflect those things for which' 
the pressman is accountable. 

Another important factor in in-process inspection is 
that each pressman is responsible only for his particular 
operation and is hot penalized in the quality record be- 
cause the material with which he is working may be relative- 
ly more valuable. Defective conditions from previotls oper- 
ations are not charged again during the current inspection 
unless these previous defects result in new defects. The 
plea that the operator or pressman is not responsible for 
the substandard material upon which he performs his function 
is only partly valid. Accountability there must be for the 
substandard material that adversely affects the quality 
record during any inspection. Its continued use nftii^t be the 
responsibility of Production and defects cause by it charged 
to the accountable source. 

Figure 1 is a daily control chart. The figures entered 
in the body of the control chart are the die positions of 
the carton on which the listed defect was found. Die 
position numbers circled in blue are #3 defects, those 
circled in red are #6 defects, not circled are minor defects. 
The two colors are herein indicated by circles and Rect- 
angles respectively drawn around the die position number. 

Control chart limits on repeat orders are based on 
standard values calculated from past data. On jobs -for 
which no past data is available approximately one day ^s 
production ( 20-24 tests) is the basis for determining con- 
trol chart values. When shifts in the process level occur, 
control limits are recalculated. 

The value of the plotted point is determined by total- 
ing all the severity points on the inspected sheet And 
dividing by the number of cartons on the sheet. 

SP/c « TSP (Total severity points) 

TCI (Total cartons inspected) Ir 

The process mean is SP/c and the standard deviation is /SP/c 

where k is the number of cartons on the sheet- 

Control chart limits are given by ± 3 c , 

where ^1F/c is the process mean, /SP/c the standard devia- 
tion and k is the number of cartons up on the sheet- 

The statistical validity of this approach is based on 

the : 
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a. Practical equivalence of the severity point ratings 
of the three severity classifications- 

b. The limitation of defect occurrence to one per any 
one carton for any one given defect- 

c. The comparable results of treating the same data as 
defects per carton and Severity Points Per Carton. 

As a matter of fact, the control limits for SP/c are 
just a little bit tighter than D/c (defects per carton) - 
The question might, therefore, be asked, ”Why not use a 
defects per carton basis?^ The answer is that operating 
personnel want to know not just that a defect is a defect 
but the type and severity of a defective condition to more 
intelligently initiate corrective action. 

Another advantage of this approach has been that jobs 
running side by side can be compared even though they differ 
in size, copy, color and number of die positions on the 
sheet. 

The daily control chart by itself, however, was inad- 
equate for the following reasons. At 7:00 in the morning 
the daily control chart is changed and quality information 
from the past 24 hours is no longer available to the oper- 
ating crews. The second shift can see what the first shift 
has done on the daily control chart and compare their work- 
The third shift can see what the first and second shifts 
have done and compare their work. The first shift, however, 
never did get to compare their record with the other two 
crews. 

A Shift Summary Chart (Figure 2) was, therefore, de- 
signed to maintain at each press the total quality informa- 
tion of the job running until that job runs off. 

In the Quality Control inspectors^ schedule there is a 
half hour overlap at the end of each shift- During this 
period the two inspectors review the jobs running and the 
quality problems. It is the task of the inspector coming on 
duty to summarize, during this overlap period from the daily 
control chart at each press, the total severity points per 
carton for the shift, along with the number and types of 
defects found. This information is posted on the Shift 
Siunmary Chart. The Shift Summary Chart, therefore, indicates 
trends that exist during the job. It points out differences 
that may exist between crews or inspectors and it indicates 
which defects are most responsible for the quality record. 
Limits fo r the Shift Summary Chart are determined by 
SP/c ± 3 /SV/'c where k is the number of cartons on the 

printed sheet and N is the number of sheets sampled per 
shift. 


There are, of course, many repeat orders on a large 
number of items- The Job Summary Chart was designed (See 
figure 3) to help us appreciate from job order to job order 
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on a ^iven item the status of control with 
job order runs off/ the Shift Summary Chart is sent to the 
Quality Control office and the data from it i^ummarized and 
entered on a Job Summary Chart - 

The purpose of this chart is to help us determin^ our 
long range ability to maintain a quality level on a given 
carton. It helps us detect trends toward better or worse 
quality as repeat orders are processed. It also summarizes 
the type and severity of defects responsible for the quality 
level. 

Job Summary Charts are reviewed by the superintendent 
before each new job order is run on a repeat item. The con- 
trol limit formula for th^^^J^ Chart is; 

Sf/c ± 3 / ^rjc where k is the number of d^^^ 

v kT positions on the sheet and iff,..,, 
the total. number of tests. 

To appreciate the effect of quality changes on a de- 
partment basis, the Department Severity Points/ Car ton Chart 
was designed. The daily and monthly Printing Department 
record is based on the aggregate effect of all jobs running. 
Figure 4a is the chart of mqnthiy averages as it appears in 
the monthly Quality Progress Report- Figure 4b is the chart 
of daily averages for the period covered by the monthly 
report. 

Two sigma limits are used on the J^PUfehiy chart and 

three sigma limits on the daily chart- 

Figure 4a illustrates a shift in the process level 
which resulted frpin the deliberate introduction of ai| as- 
signable cause. In May 1956 it was ciecided that protecting 
loads of board from changes in humidity might result in 
fewer defects due tO wavy board. At that time the i^epart- 
ment SP/c record had been maintained for seventeen mc|nths. 
The process mean and standard deviation were calculated. ‘ 
Thus far the process seemed reasonably stable and 
rather th^n three sigma limits were used to give us 4 better 

chance (with greater risks) of detecting a shift in the 

process level. 

June was out of control and also the best qualitjy 
record since this chart was begun, July and August fere 
also out of control on the low side^,^ m of August 

we were pretty well convinced that a permanent shift “in the 
process level had taken place. September's average made us 
wonder whether the beneficial effec^^ was only to be gained 

during the hot summer months, Octoiber ts average did "^ little 

to dispel that doubt. However, November and Decembet^s 
averages indicate the beneficial effect of the assi^able 
cause introduced is a permanent one and independent of 
seasonal fluctuations. 
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A potentially serious quality problem in the Printing 
Department is offset- Offset^ in this case^ means the 
transfer of ink from the surface of a printed sheet to the 
bottom of the sheet above it in a load of printed sheets- 
This occurs when the ink does not dry properly- When the 
loads are repiled several hours after printing, a sheet is 
selected a few inches from the bottom of each load and in- 
spected for this offset condition- The pressmen^ s identi- 
fication is on each sheet. The offset condition can, there- 
fore^ be charged back to the right shift and pressman 
although the repiling may take place on subsequent shifts. 

A quality record is maintained by individual pressmen and by 
crew as well as department- 

After keeping the offset record by crew for a few 
months, it wai^ noted that although the three crews were 
usually quite close together, crew A was consistently show- 
ing the best percent defective , off set- Was crew A signifi- 
cantly better? We thought so- It was felt that if the 
difference between crew A and the other crews was signifi- 
cantly different, even if the absolute difference seemed 
relatively small, that the possible existence of a favorable 
assignable cause could be investigated - 

Our null hypothesis was that all crews are the same and 
that apparent differences are not real differences- Let a 
equal the number of ways in which crew A can have the worst 
record- Let b equal the number of ways in which it does not 
have the worst record- a and b are mutually exclusive and 
equally likely to occur. There are three crews- Therefore, 
a « 1 and b = 2. 


The probability of a is a/a+b = 1/3 

The probability of b is b/a+b = 2/3 

At the end of eight months it was noted that crew A had had 
the worst record only one month, crew B three months and 
crew C four months- 


We wished to determine then the probability of crew A 
having the worst record for one out of eight months when the 
probability of the worst record for any one month is 1/3- 


P/c\= Nl aCbN-c 
(n/ c2 (N-c)! 

P/l\= 8 j (0,33)^(.67)^ 

I"?/ TTTf 


= (8)(0.33)(.06) 


» .15 


This was not a sufficiently remote probability to be signi- 
ficant- 
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However, at the end of twelve months, there was still 
but one month when crew A had the worst record. 

/ 1 12 ! ( 0 . 33 )^(. 67 )^^ 

in 1! 11! 

= ( 12 ) ( 0 . 33 ) (. 0122 ) 

=5 , 048 

This seemed fairly significant. Only 4 » 85S of the time could 
such a record have occurred due to chance 

gation indicated that operating techniques were consistent 
between shifts. Crews rotate once a week between shijtsj^iq 
there is no reason for crew preference. The distribution of 
good pressmen seemed balanced between crews- ' 

It was then asked, ^'Is the foreman of crew A a ^ 
supervisor? If so, what does he do differently to control 
offset that might be incorporated in the supervisory 
practices of the other two foremen?” Afekt^^ there- 

fore, directed to the foremen. Another twelve months passed. 
At the end of twenty four months, crew A had had the .worst 
record f or three of those months , 

( 0 , 33 ) 3 (. 67)21 


= (2024) (.0359) (.000223) 

= .0162 

1 . 62 ^ of the time such a record could occur due to cliance 
cause. This seemed tP be sufficient proof of a significant 
difference. There was also evidence of better supervisory 
practices by the foreman of crew A. ■ 



Quality Control procedures in the Cutting Department 
are essentially the same as in Printing. Only the defects 
have been changed. There are, of course, a larger proportion 
of functional defects, many of which can only be evaluated 
visually. One thing different is the approach to stripping 
defects. Stripping is the act of rempving scrap from the 
sheets of cut cartPhs- Tbe n^bnrp of th^^^^ act i^ 
most stripping defects are critical defects. Only critical 
defects are, therefore, tabulated. Stripping defects are 
limited to torn cartons, hammer marks, wrinkles or uhsanded 
nicks. 


The sample size is based on a "lift A of cartons. A^^^^ 

lift is the number of sheet g pulled at one time from; the 
cutting press by the strippers to be hand stripped. To 
determine the number pf cartons in a^^M a multiple pocket 
scale is placed along side the lift. To determine whic^^^ 
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the applicable scale for the job order on a press, 50 cartons 
are chosen at random at the beginning of the run. The total 
caliper of these 50 cartons are compared with the multiple 
scale. The number 50 on the particular scale which comes 
closest to the total caliper of the 50 cartons is the scale 
used throughout the rest of the run. A lift contains from 
100 to 300 cartons. The nature of stripping defects also 
makes it possible to detect these defects by fanning rapidly 
through the lift- The control chart used is the p chart 
(figure 5). While lift sizes may vary, they do not vary 
enough to prohibit using the conventional p chart. 

Gluing 

Quality Control in the glue room is a combination of 
in-process Quality Control for the gluing operation and an 
out-going quality check on printing, cutting and gluing 
operations. 

At the present time there are two different types of 
sampling procedures in the glue room quality check. One is 
a sampling with time, the other by units of production. The 
first is a continuous quality audit which requires subsequent 
changes in the stringency of production screening to maintain 
the A.Q. L. The second considers two or three consecutive 
containers of cartons as a lot and employes a lot by lot 
acceptance sampling plan to maintain the A.Q. L. Rejected 
lots are 10056 sorted. 

Two types of control charts are used in the glue room. 
One is the combination Severity Points /Carton chart (Figure 
6) for printing, cutting and gluing defects. The other is a 
cumulative fraction defective control chart (Figure 7 ) which 
plots a defective quality index based on defectives rather 
than defects or severity points. 

On the combination Severity Points/Carton chart a 
double graph line is plotted on the outgoing quality recheck 
of printing and cutting defects but without control limits. 

On the gluing defects chart graph grid there are limits. 

The Cumulative Defective Chart was designed to supple- 
ment or substitute for the conventional fraction defective 
or percent defective control chart. It makes use of cumu- 
lative sample size and the result is increasing reliability 
of prediction of lot fraction defective and relationship 
between this fraction defective and statistical control 
limits. 

Only computations involving addition are required by 
the user of this chart. The point last plotted reveals th’e 
number of defectives thus far, the fraction defective of the 
cumulative sample, and the relationship of the lot to con- 
trol limits. The control limits come ever closer to the 
A- Q. L. as the cumulative sample size increases- This is due 
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to the fact that;, as a sample size increases, its average 
tends to come closer to tjfie true population average- 

Points inside control limi^ from random qauses if 

the subgroup samples are random. A point outside of control 
limits presses the conclusion that the conditions which 
causes the process to deliver at the A-Q-L. no longer exist. 
It is required that either corrective action be takqn to re- 
institute the formor set of conditions or accept a new 
A. Q.L. with different limits. 

The chart is adaptable to variations in lot si; 5 e a^^ 
sample size, and can be readily applied by personnel of 
limited background. 

Glue lap>-Score Caliper Control 

An application of the use of an T and R Chart 
the control of caliper relationship between glue lap and ' 
parallel 180^ scores of glued cartons. 


The customers! specifications call for the caliper of 
the far edge of the carton to average the same as the glue 
lap with ± ,001 inches tolerance limits for sa^ averages. 
The near edge of the carton was to caliper . 006 inches less 
than the glue lap with the same tolerance limits, gample 
size was twenty cartons. 

For control chart purposes, a sample of n = 5 cartons 
was chosen. The relationship between standard deviatiqns 
and sample sizes is: 


On 


iT^ 


where n_ =20 and n^ 
1 2 


5- 


This equation states that the rat ip of the standard'. 4^ 
tions varies inversely as the ratio oif the square roots of 


4-470 
I. 235 


the sample sizes: 



✓20 

1— 1 

2cr. 


This tells us that if the averages of five cartons Jstay with 
in ± .002 inches that the averages of twenty cartons will 
stay within the specif ied limits of ± • 001 inches. Cpuld we 
meet those specifications? First, it was necessary to 
determine process capability. 

The first T and R Chart (Figure 8) indicated that glue 
machine adjustments could be made to bring the average cali- 
per where specified and that the specified limits coincided 
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quite closely with process capability. In fact, spec limits 
are a little looser than statistical limits based on normal 
process variability. 

Defect Standards 


At a central location in the carton plant there is main- 
tained a file of standard defects. These standard defects 
represent categories of items which have been classified 
according to carton plant department similarity of quality 
requirements, style and copy. The ideal situation would be 
a three p^irt specification book for each item, or one book 
for each carton plant department due to the size of the book. 
This would mean, however, hundreds of defect books. The 
items were, therefore, categorized. 

There are five to ten categories in each carton plant 
department. Representative defects selected from each cate- 
gory are a guide to the severity evaluation of the Quality 
Control Department, Disputes between production and Quality 
Control can, therefore, be referred to these files. The 
defective condition in dispute may not have a file defect 
from that exact area on the carton or perhaps even from that 
carton but the range of standard defects in that category 
usually leaves little doubt as to the severity of the defec- 
tive condition in dispute. 

While standard defects tie down specific defective con- 
ditions, visual evaluation of quality is of necessity a 
mental concept. This concept is best expressed in the 
definition of the three categories of severity. Inspector 
experience is, therefore, important. This concept must be 
learned, become ingrained, because if every defective con- 
dition found had to be referred to the standard defects for 
comparison then very little inspection would be accomplished. 
Far more inspection and, therefore, control is attained by 
using the defect standards principally to maintain the 
stability of the inspector mental evaluation level. It is 
better to tolerate variation around this level as a result 
of subjective evaluation than to circumscribe the sample size 
by insisting on exact comparisons with the standards. 

The consistency of subjective judgement has been deve- 
loped so well by our experienced inspectors that a new job 
starting up for the first time can be evaluated immediately 
and accurately in terms of the category of items which it 
fits. Later, decision by both production and quality control 
management as to the severity of standard defects of the new 
item almost always finds complete agreement with the inspec- 
tors^ judgement. Our long range goal is always to replace 
judgement with objective test methods of measurement. How- 
ever, should the time ever come when every quality character- 
istic can be measured objectively, I doubt that the nature 
of our product would permit us the luxury of a large number 
of exacting physical tests on every carton of every sample. 
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Periodic Quality Reports to Management 

1. Daily 

Daily reporting to carton plant management of the pro- 
gress of quality is implemented by: " 

a. daily control charts 

b. representative samples and defects 

c. daily and cumulative summary by job (Figure 9) 

The Daily and Cumulative Summary sums up for every 24 
hours on each job that is running the total number of major 
and critical defects by type of defect/ On some jobs con- 
trol by individual defects is more important than the aggre- 
gate effect of all defects- This summary permits a daily 
revaluation by individual defect and total defectSx' Circl- 
ing of listed values on the report indicate to production 
management when selected AQL or target maximum values have 
been exceeded. 

2 . Monthly 

The monthly Progress Report summarizes all inspection 
data month by month for a period of two years or mohe so 
that long range trends can be appreciated- It also; details 
the daily picture during the month covered by the report. 
Figures ia and 4h are one type of chart which appear in the 
report. As much as possible, all data is reduced tp graphs. 

Monthly averages are maintained on a master graph. 

Only one point is plotted at the end of the month fpr each 
control characteristic- The master graph is then photo- 
graphed and transferred to a printing plate as part of the 
multilith office reproduction process- Because of 
of master graphs only the most recent issue of the monthly 
Progress Report need be filed. Each issue summarizes all 
past data. 

One purpose of the Progress Report is in analyzing and 
reporting board mill data to aid in determi^^^^^^ the’ accuracy 
of board specifications. For example, the weight- caliper 
relationship of paperboard grades is extremely impoirtant. 
Failure to meet the specified basis weight for a given cal- 
iper is usually due to one of these reasons: 

1. inaccurate specifications 

2. short term Inability of operating crews to meet 
specifications 

3- deliberate departure from specifications 

The Progress Report grade run analysis helps establish 
accurate and realistic specifications. 

Speci al Pr oj ects 
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1. Analysis of Variance 


In a study in the Cutting Department, cutting knives of 
different material were used under various conditions to 
determine which type of metal gave the best wear. In order 
to compare these metals it had to be determined that each 
test was sufficiently homogeneous as to indicate that a good 
normal makeready had been performed on the press and, there- 
fore, valid comparisons could be made between runs. 

Three rows of measurements were made around and across 
the cylinder. Analysis of variance (Figure 10) on one press 
indicated that conditions from bearer to bearer across the 
cylinder were uniform and that conditions around the cylin- 
der were not. This meant that before around- the -cylinder 
variation could be checked on 65 chrome metal on printed 
board against another metal on printed board that a new and 
better makeready would have to be done. That part of the 
experiment would then have to be repeated. Apparent dif- 
ferences between metals were then tested for significance 
with the t test. 

2. Linear Regression 


A grade of board is made at the mill with an asphalt 
center as a moisture barrier to protect the customer's 
product. To control the amount of asphalt the water vapor 
transmission rate must be determined. As a laboratory test 
this is slow and relatively expensive. A possible method of 
measuring this asphalt layer is an air permeability test 
which can be run in the mill quickly and conveniently. A 
series of measurements indicated that there was a relation- 
ship between air permeability and WVTR (Water Vapor Trans- 
mission Rate). How good was this relationship? Was it 
linear? Could a predictive equation be derived which could 
be used to effectively control the thickness of the asphalt 
layer within the WVTR specification limit? 

A series of I40 readings were made with air permea- 
bility as the independent variable and WVTR as the dependent 
variable. Of these I 40 readings 136 formed a linear, rela- 
tively tight scatter diagram. There were four extreme 
values which were discarded as a result of a randomness 
test. The I 36 points were homoscedastic and fell within 
± 30 . All but five fell within 2a and those five were 
just outside ± 2a. 

The maximum specification limit for WVTR was 5*0 (see 
figure 11). It was felt that 2.5^ of values exceeding this 
maximum could be tolerated -- ± 2a limits were, therefore, 
used. The intersection of the WVTR specification limit 
with the upper 2a control limit indicates the upper limit 
of the air permeability value. 

The relationship between air permeability and WVTR was 
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found to be good enough to replace the laboratory tests- 
The rapid air permeability tests in the mill re du there- 
fore, the expense of testing and resulted in more effective 
control in the mill during manufacturing. 

3 - Key Sorter Punch Card File 

Board mill data from standard board grades which com- 
prise most of our tpnage is summarized by order and entered 
on Key Sorter Punch Cards (see figure 12). The storing of 
data in this manner enaJ^ins us to ana board character- 

istics quickly and conveniently on any individual or com- 
bined basis of listed quality characteristics. 

A typical example of a request for information might 
be; "How much of the time on all orders of Bleached Manila 
that ran from June to December on machines #4 and #5 were 
the run basis weight averages above and below specif ica- 
tions?” or ^During 195S and 1956 what was the caliper- 
stiffness relationship on machine #3 on all runs of 
Patent Coated Splid Kraft Back?” ■ 

On the first request the needle first rejects cards 
from all the machines but #4 and #5. It then rejects all 
the grades except Bleached Manila. eliminates all 

the dates from June to December- The basis weight 

information on the remaini^^ cards, therefore, can be tab- 
ulated and the number which, fell ab^ and below the 
specified basis weight determined. 

On the next request the needle first isolates m^^^^ 

#3 data cards- It next selects White Patent Coated Solid 
Kraft Back grades. It next rejects all dates but 19ls and 
1956. A scatter diagram and subsequent regression analysis 
can then be made between caliper and stiffness on thp grade 
selected- 

Industrial Relatipns PrQfel^^^^ of Quality Control 

We feel that the greatest problems still facing* Quality 
Control today in our company are the personal rather than 
the mechanical aspects of the quality program. It is felt 
that the control charts, statistical and pther analytical 
techniques and reporting procedures are effectiye and t^e 
right approach for our particular problems. However; there 
is and may always be an underlying antagonism from a few 
people who resent the objective publication of quality in- 
formation. One f preman tpld^m^ ^During the war we had to 
accept people for pressmen who we renVt really pressmen - 
Then Quality Control came along after the war and forced 
them to be the pressmen they said they were and for which 
they are getting paid- ” 

To the man on the press we are sometimes a system which 
has no heart, which does not sympathize with his temporary 
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problems which he feels are at times beyond his controls We 
are not fair^ he feels, in maintaining a spotlight on his 
quality record. Both he and his foreman sometimes feel that 
we are the cause of strained relations between them. 

Perhaps so. The Quality Control system calls for 
defect accountability. The Quality Control system forces a 
decision as to whether a defective condition should be 
corrected or allowed to continue -- in fact, a continuing 
pattern of decisions as to whether the customer will or will 
not accept a defective condition and if so, how much. 

Some pressmen wonder why a category of defect severity 
which is defined as one ’^that which will always be accepted 
by the customer ^ needs to be marked up at all. 

Superintendents sometimes feel that action taken by 
operating people is designed less to meet the optimum cost- 
quality picture than to make the control chart record look 
good. One superintendent has stated that pressmen may be 
relying too much on Quality Control to find defective con- 
ditions and this results in the pressman not checking 
accurately enough or frequently enough his own work. 

There are always, of courscj, old timers who feel it is 
popular to dislike a staff function such as Quality Control, 
Interestingly enough these people are usually the most 
effective users of the Quality Control system. Their atti- 
tude is not unlike that of a twelve year old boy who was in 
love with a girl but would have died before admitting it. 

These Industrial Relations problems do ex;Lst. However, 
most operating personnel want and like Quality Control, 
Quality Control is different things to different people. 

How different people feel can be best expressed in their 
own words. 

Pressman - •*! depend on the inspectors a lot especi- 
ally when I have a makeready on one press. They give us a 
lot of information. These are the best girls now we have 
ever had. It is a very rare occurance when they miss 
anything. " 

Foreman - '^Things are going pretty well between us 
(production and Quality Control), I don’t think they can 
do much more unless they get a hell of a lot more training 
than they are ever going to be able to get. They do find a 
lot of stuff that we don’t. Of course, we might find it 
sooner or later but it is better to have it found sooner 
so that we don’t make anymore bad stuff,” 

Pressman - ”I don’t mind admitting that there has been 
times when they have saved my neck. It has also saved the 
necks of others whether they admit it or not. There have 
been many times when they have found things that I hadn’t 
noticed. To me, Quality Control may be the difference in 
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letting 200 or 300 or 2,000 or 3,000 bad cartons run, 

They^ve got their job to do and I have got mine. Soine of 

the guys in here who said they don^t like women coming in 

and telling them what to do and they don»t like Quality 

Control are the first ones to yell when the Quality Control 
gir l misses anything, 

Pressman - "Especially when I am busy on one press and 
don’t have time to take many tests on the other one J de- 
pend on them a lot. I have told them to bring me informa- 
tion of serious defects just as soon as they can and they do 
it. That is a big help. Some of the men think they mark 
too strict but it is their job to find it and mark it up. 

They are a big help to me." 

Pressman - "You have a G-- D good bunch of girls 

here and they are a big help. Why there has been many times 
that if they hadn’t brought a sheet back and showed me where 
something was I might have run a 1,000 sheets or more before 
it was found- My eyes aren’t what they use to be anjji her 
bringing the sheets back with the defects circled is a big 
help. They really give those sheets a going over.” 

Pressman - ’’Your job is to find and get the information 
and get it to us. Thereafter it is up to us to do something 
about it- I don’t know what else you can do. Sometimes the 
guys feel the girls think they have to find something oh 
every sheet but of course, it is pretty hard to not have 
something on every sheet. You have got sheet to sheet vari- 
ation, thickness, smoothness and so forth and it would be 
pretty hard not to have something show up as a defect." 

Foreman - "The girls do a lot of good. We need them 
out here and couldn’t do without them. Sometimes I get 
pretty busy. The other day, for instance, I had two' or 
three okays in a row and if it wasn’t for the fact that the 
girls make those periodic checks a lot of things would get 
by. 

Frequently, all I have to do is walk down the aisle and 
take a look at the control chart and if I see something 
wrong I can immediately go and check out the source,;; There 
was one job where unsanded nicks and torn cartons wehe 
found by the girls. An inspector had found three ok|iys in 
a row. All of a sudden on her fourth test the graph line 
took a big jump up and when I saw that I went immediately to 
the source of the trouble and found that the strippers had 
not been following instructions. I shut the press down 
right there and then and had an education session with them. 
Now if that graph line hadn’t been thore to show me 1 would 
have probably walked right on by and not gone over to check," 

Pressman - "Take today, for example- We were breaking 
in a new feeder and it was breaking us in too. There were a 
lot of things wrong on the sheet. Trying to get the bugs 
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out of this feeder we don»t have time to check the sheet 
very carefully. It is a big help to have them come and look 
at the sheet and know that everything has been marked down 
in detail. You have got a good bunch of girls here. « 

Foreman - "Before there was Quality Control the foreman 
might have seven or eight presses running. Maybe three 
okays one right after another. It might take him two hours 
or so to get back to the press running in the corner. Now 
the foreman knows the presses are being checked regularly 
by Quality Control inspectors and that makes it a lot 
easier for the foremen." 

Pressman - "They (the inspectors) are an extra pair of 
eyes." 

Summary 

In this discussion there has been an attempt to illu- 
strate the use of Quality Control in the paper industry as 
it is practiced at The Gardner Board and Carton Company. 
Management's philosophy of Quality Control and some of the 
control techniques have been highlighted. Some of the 
Industrial Relations problems which must be overcome in 
selling Quality Control to people so that thBy will use it 
and profit by it have been detailed. Our program is in a 
constant state of flux. Control charts are being refined, 
new techniques investigated and adopted, and reporting pro- 
cedures improved. 

Most distributions of data with which Quality Control 
is concerned follow mathematical laws. This makes possible 
the development of scientific procedures for the control of 
quality. 

Quality Control is concerned with people, therefore, an 
understanding of the fundamental nature of people is neces- 
sary if a Quality Control system is to be successful. 

In our company we have tried to understand the basic 
nature of data. We have also tried to understand the basic 
nature of people. If our Quality Control program has been 
successful it is because of our attempt to understand and 
integrate these factors -- plus the fact that quality is a 
company policy. 
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FACTORS AFPECTIlia THE ACCURACY AED RELIABILITY OF SENSORY TglSTS : 

David R. Peryam 

Quartermaster Pood and Container Institute 

Prediction of population behavior toward foods and oontrolling 
food manufacture in ligjit of such behavior are to be big busi- 

ness • The manifold activities that have to do with flavor j odor and 
acceptance play a vital role for many oonipanies, partioularly in the 
development of products and the planning of future operations# " Tradi- 
tionally this important area has always been the domain of the expert, 
but, as competition for the consumers* favor has become keener ,i interest 
in the scientific approach has grown* The idea appears ever more reason- 
able and economically sound that we can predict what consumers W masse 
are like ly to accept , and that through sensory te sting we can manipul^ 
the flavor factors which are oruoial to acceptance* 

■ p ■■■■■■ ■■ 

A great deal has already been achieved, but the impression is cur- 
rent, even among those who have successful programs, that this kind of 
testing is not on as sound a basis as it should be* if the precision 
of physical measurement is taken as a model# measurement in sehsory 
testing may seem inaccurate and unreliable. This attitude may or may 
not be justified* There is cons ider able cohfusloh in this area* People 
with many different scientific and experience backgrounds are working in 
it, are trying to find out many differeht thihgs,^ a^ using many 

different approaches* The field is not systematized and integrated* 

Thus, when inaccuracy and variability are noted, their causes ahd poss- 
ible means of control are not immediately clear* 

My purpose is general inquiry into the factors involved, but using 
review and disoussion rather than exposition* The objective is to pro- 
vide orientation, rather than to impart specific information* :The 
latter will not be consciously avoided* However, I will not aseume 
responsibility for providing solutions to the problems raised# tut will 
simply try to get them into perspective* Throughout we will be- ooncarned 
with measurement— measurement both of hirnian behavior and by mew 
human behavior* Basically, then, we are in the field of psyoholo^^ but 
we shall try to maintain the applied viewpoint of one who is mofe inter- 
ested in products than in the human behavior as such* 

What kinds of def icienoies in sensory test results are altegedt 
Without being exhaustive we can mention the followings failure to dis- 
criminate differences in quality between products, disagreemeht among 
individuals or among groups in values assigned the same product# or 
changes in the values assigned by the same person or group of persons 
upon different cocas ions* Finally, we should note that sensor 3? testing 
is often blamed simply because of fail\ire of the test results to confirm 
the experimenter's expectations as based upon some validity criterion 
suoh as a known physical variable* Some of these reasons are ^ertainiy 
valid while others, e*g*, the last, probably are not* 

In this area is it reasonable to strive fbr ihe same order of pre- 
cision that we expect in physical measurement f Both the possibility and 
the desirability of achieving this end are questionable* 

The judged reliability of sensory tests may depend upon oxis's point 
of view* If our objective is to reproduce the same values as closely as 
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possible from time to time and place to place, tto may conclude that they 
are xmreliable# In this limited context the disorepanoies are consider- 
ed as error; hoiwever, we may otherwise consider the observed differ- 
ences as indicating real changes in test conditions or teat populations* 
Thus, they are important in their own right and give us essential in- 
formation. The trouble is that usually we don’t know what these con- 
ditions are; therefore, we don’t know how to interpret the variability* 
Many of the measures we use must inevitably remain variable, hence sub- 
ject to the suspicion of unreliability, because we use them to obtain 
information about phenomena which are innately variable* But the amount 
of this innate variability itself varies according to test objective and 
test form, so let’s look at both# 

In discussing types of tests a rather coarse grouping will be ad- 
equate for our purposes* Four types have been defined and are presented 
in Figure 1* You will note that one tjrpe is outside the scope of this 
paper, being labeled as “non-sensory'** However, it is included because 
it will provide some useful comparisons* The distinction between sen- 
sory and non-sensory is easy; the term "sensory” is reserved for those 
types of tests which involve actual samples of food* They are con- 
trasted with the survey type, where the subject responds to the idea of 
a food as represented by its name on a questionnaire* Typically, 
sensory tests belong in the laboratory, and surveys out in the field* 

The survey objectives are broader# They seek to measure learned atti- 
tudes and opinions. From them we may infer the behavior potential for 
types of products, i.e., how “popular” they are, but rarely can surveys 
provide specific information# You might say their piirpose is to get at 
the characteristics of populations* Inconsequence, their value is 
markedly reduced unless they are conducted on a fairly broad sampling 
basis* 


Three types of sensory tests are shown. Nearly everything can be 
so classified although, in practice, mixed types are sometimes encount- 
ered# The first type, preference, is best exemplified in the paired 
preference and hedonic scale tests so pqmmpnly used in research and 
development work# People are given samples of food to eat, either in 
pairs, where they are asked to say which sample they prefer, or singly, 
where they are asked to rate each sample on a scale showing successive 
degrees of dislike and liking# These laboratory tests and the surveys 
are alike in that both are concerned with the "affective” response, i* 0 *, 
how people feel about foods; but, in theory as well as in practice, the 
objective is different* 

Laboratory preference measurements are certainly affected by the 
same attitudes that determine the questionnaire responses, but w© know 
that preference for foods can vary widely depending on their specific 
flavor oharaoteri sties* The surveys cannot measure such variation; 
this requires that the foods themselves be present* Ordinarily labora- 
tory tests are not used to establish population levels of preference* 
They have some value for this purpose, but the results must be inter- 
preted with caution because of the restricted samples of people custom- 
arily used and because of the dependence of the results upon the spec- 
ific conditions of the test# Their greatest value lies in establishing 
relative preference among comparable treatments* It is assumed that 
particular test conditions and general attitudes, which seem to contrib- 
ute most of the variation within the population, will affect all treat- 
ments equally* Experience has shown that this is a fairly safe assump- 
tion— that relative preference tends to be stable. 
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Inoluded in preference type are "quality evaluation" tests# 

One example would be the typical operation using a small panel where 
samples are rated on a scale pf "poor" to "exoellant”; another example 
might be the work of professional graders of butter, tea, coffee, eto.« 

Defining such tests as preference will , not meet unanimous^^agree-- 

fflont— many people would contend that these are primarily difference 
tests j however, the best evidence shows that, basically, they are eval- 
uating on the preference continuum* They differ from other preference 
tests only in the scale used and the m^^ of the panel# 

The objective of difference tests, the next type, is to apprehend 
flavor differences in order to relate them to processing, formulation, 
raw materials, or some other factor* The most familiar is the 

triangle test, along with its many variants, such as the duo-trio, 
where we attempt to determine simply whether there is a date otable diff- 
erence between two te st materials • Another ex^ple would be ttie , com- 
parison of particular flavor oharacteri sties by means of a rating scale 
of intensity* These are re sear oh a lad control tool e deal 

with materials and processes in terms of their probable flavor.; result^ 

ants* Basically, we are measuring discrimination, but in a context 
where conditions are made optimal* Such tests are usually run with 
special panels— no one worries about the sampling of subjeota*;^ This is 
justified in two ways. First, capacity for discrimination v a** I qs a 
great deal less among people than does preference* Further, difference 
test results usually would have little meaning as applied directly to 
the oons\mier population* They are seldom used to predict acceptance 
behavior* 

Flavor description has been set up as a separate type beoause, even 
though it belongs with the differenoe tests in the sense that it exolu^^^ 
preference and measures only discrimination, it is more complex than the 
differenoe tests* The objective is more ambitious— not just tp deteot 
flavor changes but to provide integrated qualitative and quantitative 
information* The most familiar example is called the Flavor Profile, 
where a special panel works extensively on a given product* This method 
first determines the flavor properties which are important and develops 
a naming system* Then the verbal system is used by the panel to analyze 
the flavor of samples of the same type, by indicating the intensity of 
each component. Other approaches differ in details, tut they ape basic- 
ally the same as the Flavor Profile* Flavor analysis is another re- 
search tool whose value lies in the support it can give to the technol- 
ogist who has to know the relationship between flavor and materials and 
processes* Again, results require interpretation; no one expects to 
apply them directly to preference problems* 

We have already siiggested some reasons why these types of tests raay 
be affected differently, as far as precision and reliability are oon- 
cerned, by differences among people, environmental conditions^- or test 
situations* Tal)le 2 will help us explore this topic further.! It 
attempts to show the relative importance of various factors wl|iqh in- 
fluence ihe results of sensory tests* Again the surveys are inoluded 
for comparison* This scheme is proposed only as a means of encouraging 
oontrolled thinking on the subject* Certain of its major fea-|ures have 
merit, but there are other points that might be hard to dSfend* For 
example, the list of factors is far from complete, factors arb not 
mutually exclusive, important interactions have been disregar4od, and 
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finally, the levels of importance vary so much that the variation 
cannot he adequately represented on the six -point scale# The scale is 
suoh a rough one that only the end-points have been tied down, as 
**0 ® negligible** and ’*5 " very important**# Comparisons among factors 
within tests are probably more valid, but comparisons between tests 
are supposed to be meaningful, too. 

The first three factors listed represent familiar ground. Sensory 
properties of foods and attitudes toward foods are the things we intend 
to measure, and it is indeed encouraging to be able to assign high 
values to them. Sensory properties are hi^ on all of the sensory 
tests and **0** on the surveys. Long range attitudes are **5** for surveys, 
**4** for preference tests, and ”0** for the others. But now we must re- 
cognize two different sets of attitudes— not only long-range response 
tendencies derived from past experiences which have been well integrated 
into the individual personality, but also short-range influences derived 
from one's present relationship to his environment and that in the 
recent past— such things, for example, as the bad hamburger you ate last 
week, the raise you didn't get, your knowledge that the boss is very 
anxious about the newly developed product, or your awareness of the 
pretty new secretary in the next panel booth# Sometimes one is inter- 
ested in suoh short-range effects, but usually they must be oonsidered 
as only interference because they shift around so much that they have 
little predictive value. They have most effect on the preference 
tests, both sensory and survey, but cannot be completely disregarded in 
the other types because they can also affeot disorimination. 

The rest of the factors listed, for all practical purposes, may be 
considered solely as sources of error. To increase accuracy and relia- 
bility we have to control them or learn to understand, and account for, 
the variability they contribute to our test measures. 

The next item, physiological factors, covers a broad range— really 
too broad to permit proper assessment of its relative influenoe. Here 
we would include suoh long-range influences as the need for calories, 
a person's state of health, adjustments to temperature conditions, age, 
and many others^- also short-range effects such as the momentary state 
of hunger, temporary illnesses, or enviromental oonditions that inter- 
fere with the flavor senses. Most of these things can affeot sensory 
preference tests, and perhaps this factor should be accorded a value 
higher than **2**. However, in practice the combined influenoe is prob- 
ably not as great as the number of possible causes would seem to suggest. 
They have been rated a **3” on the other sensory tests because of their 
potential effect on disorimination, and bs cause disorimination is the 
sine qua non of these tests. 

Basio sensory capacity could properly have been included above, on 
the grounds that it is physiologically determined, but has been set 
apart in order to make a special point. That people differ widely in 
basic capacity to detect tastes, odors, and other stimuli can be easily 
demonstrated. These differences are due partly to differences in gen- 
etic endowment, partly to things that have happened later in life. Con- 
cern has often been expressed about the implioations of such variations 
for sensory testing. However, for certain practical reasons, this 
factor has been relegated to a minor role* The reasons will be dis- 
cussed later. 


678 



The next factor group, motivation and attention, could have been a 
sub-class under attitudes, but deserves special ir»ntio beofiUAle of its 
pervasive importance# The quality of any human performance iwlll depend 
upon the reasons, and’ the strength of the reasons, which a person has 
for participating, and the related factor of how closely he applies 
himself to the task. Therefore, there must be a suff ioieht degree of 
motivation for any kind of test, although it must be considered more 
important where the task is more difficulty i«e., in difference and 
flavor de Seri pti on* The only reason this factor is not rated 
across the board is that, in practice, the potential variation from 
this source can be effectively reduced by use of the right approaches. 

Specific test skills are not important for preference testing. 

They can be designed simply so that almost anyone can understand and 
respond meaningfully, although it must be admitted that they are not 
always so constructed. Difference and flavor description tesiis, in 
contrast, require people to deal with flavors in ways that lie outside 
their day-to-day experience, and training is necessary to acqulire the 
new skills. 

The factor of language has been Included primarily because of its 
great importance in flavor description. Language is eliminated as a 
variable in difference tests, and pi®-ys only a minor role in prefers noe 
tests, although attention to the construction of scales and tHe wording 
of questionnaires is neoessary. But ?hen we begin to deal with flavors 
specifically and anal3rbioally, as we must do in order to get useful 
results from flavor description, we run into trouble. Coramuni,pation is 
in a primitiye state. We have lots of words with broad, tenuous mean- 
ings. We can say that the test sample smells or tastes '^something like** 
another substance, but we have no ready-made, reliable system "for bom- 
muni oating about the flavors as suoh. One panel member may s% **ranoid*V 
another ** oxidized**, and a third "oardboardy**, and we will never know 
whether this represent s real dif fere noes in perception or just different 
vsrbal habits. In oonsequence, one of the most importarit assets of 
suoh testing must be the development of a language system and the train- 
ing of subjects so they will use it reliably. 

Does this review point to any conclusions? In surveys, clearly the 
emphasis should be on getting a broad sampling of the population in 
order to establish relatively permanent group attitudes, avoiding short- 
range, ** interference** attitudes as much as possible. In all of the 
sensory tests, the emphasis is on control, but for various i-easons. 
Laboratory preferenoe testing requires that the sensory properties of 
foods be paramount, yet any measurements will be meaningless unless 
made within the proper context of permanent attitudes. Hence sampling 
must be as good as possibla within the limiting conditions. Beyond 
that, emphasis should be on oontrol of the other fabtdrs so that all 
treatments will be affeoted equally. Then relative preferenoe ’ values 
will remain fairly constant even though the absolute levels might change 
under different conditions. In both difference testing and flavor de- 
scription, the sole emphasis should be on control of conditions and 
operations to provide for maximuiri disorimination. This includes the 
development of test skills, particularly language in flavor description. 

Yfith this review as background, let's look at sensory testilas 
operations from another angle, considering now the various things that 
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may be done to improve their aooura<^ and reliability i*Q-ther than the 
basic factors involved* 

Physical control of the test environment* 


The attempt is usually made to create an optimal environ- 
ment for sensory testing by eliminating direct sensory interference and 
reducing sources of distraction to a low level* Control of direct 
interference with the other flavor senses can be handled in other ways, 
but elimination of odors is usually accomplished by special laboratory 
construction and air-conditioning* Laboratory construction helps in the 
control of other aspects of the environment such as noises, lighting, 
and' temperature Y^iioh may serve as sensory distraotors, thereby reducing 
attention and lowering performance* Finally, let's mention the import- 
ance of laboratory location and design as a help in achieving psycholog- 
ical control* Referring to Table 2, it may be seen that these controls 
are related mainly to two of the factor groups— physiological, where we 
attempt to get maximum sensitivity, and the area of motivation and 
attention, where we want to avoid any interference with discrimination 
or the more complex aspects of performance* 

How important are these physical controls for assuring good re- 
sults? This will vary to some extent with the type of test, being less 
important for preference* However, it's the sort of thing you don't 
question anyway* Control will do no harm even if it is not critical in 
all oases* Obviously, it would be impossible to sample all of the many 
conditions under which foods are actually consumed; therefore we use 
optimal and constant conditions* 

2* Psychological control 

Psychological control, in the broader sense, is the most 
critical area. It is here that unpredictable variation can bo most 
troublesome* The human organism is highly responsive and a person's 
behavior in a given test is a function not only of the stimuli presented 
and the instructions given, but also is in part controlled by what hap- 
pened an hour, day, or year ago, by his expectations andcfesires, and by 
other unanticipated factors* Disorimination and judgment are not free 
of such influences, but preference is most affeoted* Most of the vari- 
ation is attributable to personality, as long-range attitudes, and it 
would profit us little to attempt control, because probably we would 
leave the situation worse than it was before* We assume that their 
effects will average out among people and be constant from one sample of 
the population to another* 

But certain positive actions can be taken tov/ard control of short- 
range attitudes which, at the same time, will tend to promote better 
attention* One step in this direction is the well-known panel booths 
where eaoh person is shielded from the distracting and ** contaminating” 
effects of observing others. To make this really effective there must 
also be procedural controls to avoid intentional interference between 
subjects and by outsiders* Avery pernicious kind of short-range atti- 
tudes are the biases that can quite easily arise through the subjects' 
having independent knowledge of the products being tested and, particu- 
l6.rly, from having expectations about them, or anxiety about the test 
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results* The attitudes of management, vdiether intentionally published 
or not, can be very potent* Continual aaf awards must ‘te used to shield 
test subjects from such knowledge, or eliminate those panel members who 
may be affected* 

3* Panel select ion ...I 

Since so much of the unreliability is due to variability 
in our measuring instruments, i*e*, people, and since some pedple are 
certainly less variable and more dispriminating ^ others, it might 
be reasonable to try to improve the situation by selecting the right 
people* Basically, this is true and the possibility of thus &prov.ing 
accuracy has been demonstrated; but there are many practical llmita- 
tions* Of course, selection is to be avoided in preference testing, 
where we want to sample over attitudes, personality, and physio logical 
factors as broadly as pos sible • The bad gue s se s that can bp i]|ade by 
relying on results from small panels demonstrate this* Selection of 
subjects does have merit for difference testing and flavor description; 
however, here we meet the practical difficulties* Selection methods 
that have been tried include threshold tests for basic sensitivity, 
ability to identify flavors, ability to repeat quality judgments, and 
ability to detect flavor differences* But ’^quickie'' tests are of no 
value* Much work is required to obtain enough data to predict" a person* s 
future performance* A selectipn program usually produces a fe:w good 
panel members, a few who are definitely inadequate, ai;d a large number in 
between. Thus, one has gained little. Generally, the best plan is to 
reject only on the basis of easily detected defioienoies in aelisitiviiy 
or skill, and to use apparent mot iyatipn and interest as the mj^n posi- 
tive selection facto re, since they are rather good predictors of success* 
One can easily compensate for lack of precision in the individual meas- 
urement by increasing the size of the panel, and it is usually more 
efficient* 

4: • Physiological control of test subjects * 

There is little that can, or, perhaps, need be done about 
most physiological variables. Sometimes testing is limited to the same 
period each day to keep the effect of hunger as constant as pcssible* 
People tend to respond more favorably on preference tests wheij they are 
hungry; also it has been olaimed that they are more sensitive to flav- 
ors, but the latter is not well established* However, variations in 
hunger appear to contribute in only a minor way to over -all variability* 
I’he major concern here is with maintaihirig normal sensitivity*' People 
who have colds or are otherwise indisposed are usually eliminated from 
test panels* 

We have already mentioned removal of laboratory odors by air-con- 
ditioning. Incidental taste stimuli are not suoh a problem* jl’anel 
members are frequently asked to avoid eating, gum chewing, and smoking 
for a period prior to testing, although, contrary to what one might 
expect, there is no good evidence that non-smokers are mor^^ 
ing than smokers* People frequently forget instructions; however, this 
is not critical because most such flavor effects can be eliminated by 
mouth rinsing and a short rest before testing* Most of the difficulty 
arises from adaptation and inter-effects among the test samples them- 
selves, vfliioh must be controlled through test procedures* 
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To be realistic and thorough, one more topic must bo mentioned# 

So far Tve have avoided discussing two things which in practice, prob- 
ably have most to do with the effectiveness of sensory tests# These 
are basic test methods and test design# Having a modern, air-o,on- 
ditioned’ laboratory with panel booths and special lights where well- 
motivated subjects test under conditions of physiological and psychol- 
ogical control will not assure valid results unless basic methods and 
procedures are appropriate# They are not only more important than the 
factors previously discussed but also have a different relationship 
to the test results# For example, you cannot say that one type of test 

may be more affected than another# Selection of a method which is 

inappropriate to the problem at hand may entirely destroy the effect- 
iveness of an;y'' test# It is such mistalces, as often as anything else, 

which tend to create the dissatisfaction with sensory tests# 

We do not have time to explore this topic adequately— no more than 
to give examples of the kind of problems which are involved# 

A number of design problems arise because samples are usually 
tested in groups rather than singly* Inevitably each sample becomes 
an important part of the frame of reference for the others. This is 
good because it produces more stable relative measures but it also has 
undesirable effects# For example, in a multiple sample test, progress- 
ively greater adaptation ooours, which oan be retarded by mouth rinses 
and rest pauses but cannot be eliminated# In a preference test on even 
a short series of samples, there are progressive shifts in attitude 
which result in lower preference values for the later samples# When 
samples are presented simultaneously there is often a tendency to pre- 
fer the sample in a certain position# One frequently encounters what 
are called ” contrast effects”, e#g#, an average sample will soore high 
when presented with a poorer one and low Y^hen presented with a better 
one# There is no assured way of eliminating such effects but they can 
be adjusted for in test design# 

The field of test methodology per £e^ is a broad one* Methods are 
far from being standardized, nor is tliere ai^ published doctrine for 
their use# This places responsibility on the experimenter, “vdio must 
analyze the situation to select a method Yhioh is appropriate both to 
the problem and the test population# Some common faults ares 
(a) applying a favorite method indisoriminately to all problems, (b) 
using a difference when the problem is one of preference, or else com- 
bining the two types, (c) attempting to infer differenoes from flavor 
description data, (d) attempting to infer relative acceptance from 
ratings of specific properties, and (e) using rating scales which are 
inappropriate to the product tested or the test population# Knowledge 
and the exercise of good judg^nent on the part of those who plan the 
tests is the only effective means of control in this area of methods 
and design# 

To conclude this discussion, it would be mil to return to a 
point mentioned earlier# The factors we have discussed are not new 
discoveries; people have always been trying to adjust to them# What 
we have attempted here is to demonstrate and clarify relationships, a 
task whioh must be done in order to place sensory testing on the level 
of effectiveness which the food industries need# 
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TAble 2m Relative Importanoe* of Various Groups of 
Factors which Affect the Results of Sensory Tests 
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INTEGRATION OP TECHNIQUES IN PROCESS DEVELOPMENT 

G. E. P. Box 
Princeton University 

INTRODUCTION 

Quite different problems confront the experimenter at th^ various 
stages of development of a process investigation and quite different 
techniques are appropriate to solve them* As the last speaker in this 
discussion on the strategy of experimentation it seems appropriate for 
me to discuss the roles which various statistical methods can play in 
helping process development along and to try to see how these various 
techniques fit together. 

It is perhaps unnecessary to say that I do not believe in the pre- 
sent existence or possible future existence of any particialar statistical 
procedure which would be best in all circumstances . The current situa- 
tion in statistics is not that there are a variety of techniques in com- 
petition to fill some narrow area of endeayour. Rather the |*ield of 
interest might be likened to a large unfinished painting. Some outlines 
have been sketched and a few areas have been painted in but major por- 
tions of the canvas are quite blank. We have to recognise where these 
blank spaces are and to think -how they shoxild be filled. Certainly it 
will do no good to pretend that the painting is really complete, or that 
none of the parts which have been painted in should ever be retouched, 
or that all the blank spaces can be adeqixately filled merely by repeat- 
ing a pattern which has been used successfully somewhere else;. 

1.1 Indeterminancy of experimentation 

Someone once said that the; only time that an experiment can be 
properly planned is after it has been completed. The more one contem- 
plates this paradox the more one is convinced of its essential, tfuth. 
Consider for example an investigation involving continuous variables like 
time, temperature, pressure etc., when the true underlying relationships 
(represented by the response sinrface) between the 3:esponse and the 
variables is not known. This experimental situation, like most others, 
is beset by a bewildering nuniber of indeterminancies which exist whether 
any statistical methods are used or not. 

Which variables should be studied? In a given situation one 
experimenter might regard* one set of variables as important a|id another 
might include different variables. 

By how much should the variables be changed? One experimenter 
might for instance regard a ten degree change in temperature in a parti- 
cular context as a large change, while another might think that it was 
quite small . 

In what form should the yariables be considered? ShoiiLd we thi^^^^ 
in te'rms of time and temperature or of log time and reciprocal absolute 
temperature? Or maybe we should not think in terms of these two 
variables at all but rather in terms of some single function of them. 

How complex a model (and hence how elaborate an arrangement of 
experiments) is necessary in a part iciilar situation? For iridtance in a 
given context the approximation that locally the response surface was 
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plaxiar mi^t "be sufficiently close to allow progress to "be made using 
a single arrangement of experiments based on this approximation* In 
other contexts the approximation and the corresponding experimental 
arrangement voiild be quite inadequate. 

V/e see that in an investigation of this kind we are expected to 
explore the behaviour of a function of unknown complexity within a 
space which is not even defined. Seemingly a difficult assignment! 

1,2 "You choose the strategy, I will choose the surface". 


If more is needed to see how hopeless our task appears, let us 
play a game in which you decide the strategy for exploring an unknown 
response surface and I, acting in the capacity of "devil’s advocate", 
decide the surface , 


If you choose ; 

one factor at a time 
steepest ascent 
*fractional factorial designs 

second order fit 
grid mapping 


I will choose: 

a surface with large interactions 
a surface with many bua^s 
a stirface with large S-^^actor 
interactions 

an exponential type response 
a flat plane with a single point 
sticking out from the surface * 


.'CLthough for illustration we have confined attention to one parti - 
ciolar kind of investigation, indeterminancies which are just as puzzling 
seem to occur in other situations. One might feel justified in con- 
cluding that scientific investigation must be an unrewarding pastime 
and success a matter of purest luck. We are faced, however, with the 
embarrassing fact of the phenomenal success of the experimental method 
over the last three hundred years or so. Perhaps we are not thinking 
about things - the right way. Let us consider the experimental method 
itself for a moment. 


2, THE ITERATIVE NATURE OF EXPERIMENTATION 

It is well known that a recurrent theme is found in almost all 
scientific investigation. This is the successive interplay of the two 
coirplementary processes which we shall call processes d and a. The 
first process, d, is concerned with the movement from conjecture to 
experiment and the second process, a, with the movement from experiment 
to conjecture . These coicplementary processes are used in alternation 
many times during an investigation. By their repeated employment, the 
experimenter’s knowledge of the system studied becomes steadily greater 
in the manner illustrated in Fig.l. 


Experiment \ • • 

/\ 

Con^ecttire ^ a d a d a 

hypothesis / '^ / ^ 

model • • ’ • • • • 


Fig. 1. Iterative experimentation 
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More specifically 

process d is concerned with the devising of experiments suggested hy the 
investigator’s appreciation of the situation to date and cal - 
ciliated to elucidate it further; 

process a is concerned with examination of the results of experiments in 
the li^t of all the hackgrotmd knowledge availahW^ 

To put it in still another way: 

process d is concerned with analysis of hypothesis and synthesis of a 
suitable experiment 

process a is concerned with analysis of the experiment and synthesis of 
a new hypothesis or hypotheses# 

In a statistical context it is customary to relate these processes 
to the experiment rather than the hypothesis so that process d is asso- 
ciated with what is called the statistical design of the experiment and 
process a with the statistical analysis , In this paper the words 
"design" and "analysis" have been avoided until now for, as will be seen 
from the definitions above and the examples which follow, they are in- 
tended to include other things besides the purely statistical concepts 
usually associated with these labels . With this proviso then' the pro- 
cess we are considering is typified by the successive and repeated \ise 
of the sequence: 

CONJECTUBE ; DESIGN : SXPEBIMEI® ; ^ 

The iterative situation described above is very different from 
that iDplied by certain common usages of statistical methods . ; For 
instance "significance testing" as sometimes practiced seems to imply 
that some irrevocable decision is to be made immediately following the 
first experiment, no further observations being allowable, and that some 
dreadful misfortune will befall the 'experimehter if he errs by" drawing 
a conclusion which is not sufficiently conservative although no penalty 
will result if he falls into the error of being too conservatiye . I 
do not deny that such a situation mi^t occur but I do believe it is 
unusual*. 

2#1 An exajjple of classical iterative experimentation 

To focus attention on this process of experimental iteration let 
us consider an exanple where statistical methods are not involved. We 
will try to understand the actions and reasoning of some experimenter 
engaged in speculative research whose object is to prepare a certain 
chemical C by a route not previously investigated. at the start we 
suppose he has some, perhaps not very precise, ideas as to the general 
way that chemical C might be prepared. The iterative sequence woixLd 
then begin and the thoughts of the experimenter might follow a pattern 
somewhat like this: 

Conjecture: "I believe that in suitable circumstances reactant A woiild 
combine with reactant B to form the desired product C. 

Design : "From theoretical knowledge, my own experience, and other 

people’s experience of similar reactions cited in the 
literature, I should think that certain conditions ;X (de- 
fining proportions- of A and B, teiEperature, time etc.) 
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might he worth trying" 

Experiment; The appropriate experiment would then he performed, and this 
would include a chemical analysis of the product, 
iinalysls ; "Mter studying the appearance and physical nature of the 

product and the numerical results, it appears that a little 
of the desired product C was produced hut that a hi^ pro- 
portion of unwanted product D was also present." 

A single cycle of the sequence has now been coinpleted hut the last 
phase of analysis immediately leads to a new conjecture and the begin- 
ning of a new cycle: 

Conjecture : "The presence of such a high proportion of unwanted product 
D could he due to the large amount of water used to dissolve 
the reactants, which might favour the formation of D". 

Design : "I will perform the experiment in the same way as before, 

hut this time I will use a non-aqueotis solvent Z instead of 
water . " 

He is thus led to perform a further e5Q)eriment. In this general way 
his investigation continues. 

In some cases this process would he brought to an early stop. 

Some overriding difficulty might he encountered such as the presence of 
an embarrassing iiipurity which would lead the experimenter to abandon 
this particular route of manufacture. Eventually, however, he would 
often he led by this method to a mode or modes of chemical preparation 
which in the laboratory at least were satisfactory. 

We see that the scientific method is not, and can never he made, 
an exact procedure. In particular it is not like an exact method for 
the calculation of the root of some mathematical equation in which an 
answer is reached by a unique sequence of steps in calculation. Rather 
it is an iterative process analogous to the iterative "relaxation" 
methods of ntunerical analysis in which faltering (and in the light of 
subsequent knowledge perhaps even ill advised) steps are made at the 
beginning of the process . Because the sitviation is set up so that the 
investigator has an opportunity to learn as he goes along, however, he 
can hope to be led along one path to the solution . The path actually 
followed will differ from one experimenter to another and its length 
will depend very much on the ability of the person concerned. The 
objective of the statistician in trying to help the experimenter should 
be not to try to make the path he follows unique but to supply him with 
techniques which will help to make the process he follows converge to 
the correct solution as rapidly as possible. 

3. THREE ir-IPORTMT PH.^i5ES OF liDCPERBlEHTATION 

We shall discuss in a moment how the iterative experimental process 
may proceed in investigations in which statistical techniques are em- 
ployed^ before we do this we consider what sorts of information we 
might be seeking in such investigations. 

To avoid confusing the essential issues let us begin once more by 
considering a problem where statistical considerations are not essential- 
ly involved. 

Suppose we were for the first time studying the distance s fallen 
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by a solid body in a vacum* Initi^ly one mi^t postulate iihat s 
could depend on the levels of a nimber of veri^ u, v eiic* The 

variable t mi^t represent the. time of felli^ the variable tI tfee 
weight of the body, the variable v the volume of the body and so on. 

Thus we conceive a possible functional relationship between the 
response s and the ’Variables^’ t, u, v etc, 

s as f(t, u, V . . . ). 

Three distinct stages can be considered in the investigation of 
such a relationship; 

i) Study aimed at deciding ^ICH variables effect the response. In 
this example it would be found Jhat (to the degree of exictness 
here considered) s depended only on t. 

ii) Empirical study of HOW the variables affected the .i^sponse. In 

this example experiments would enable us to plot a graph;' showing 
the relationship between s and t oyer a certain of t . We 

might present this informtion either in the form of the' graph 

itself or in the handier, fom ;Obtai^^ by describing the' graph by 

the equation of some simple curve (e.g, an interpolation!; poly- 
nomial) which gradxiated it in the region concerned. Such an^ 
equation would of course make no claim to have any basic meaning 
and woild usueLlly be inapplicable outside the region actually in- 
vestigated. 

iii) Theoretical study which resulted in an equation derived from a 

postulated mechanism for the phenomenon studied. This inight 
explain more or less adequately ^ WHY ^ the response was affected by 
the variables in the manner pbse^ present exan^l.e New- 

ton's gravitational theory leading to the formula s « |gt^ would 
provide such a theoretical equation. 

We are thus able to distinguish three coiiiponent phases of investi- 
gation, each of which can involve the us^ statistical, 

methods. These are; 

i) Screening studies aimed at delineating the important variables, 

ii) Empirical studies aimed , at descri^^^ important features 

of the relationship between the response and the variabjes ^ ( 

the "effects” pf the variables in so^e particular region, or more 
ambitiously the principal features of the multi -dinien signal graph 
or "response surface" relating the response and the variables in 
some important region of the variables), 

iii) Theoretical studies a.imedrt plausible me chrisms for 

the phenomena studied, and estimating to satisfactory accuracy the 
relevant parameters. 

All these phases usually involve the same iterative sequence - 
COITJECTUBE, DESIGN, EXPERIMENT, .WALTS IS, so that in terms of complexity 
although not necessarily of order in time, the route followed resembles 
Pig.2. 

This route shpid.<i bo likened t^ an ufilimited access highway. Few 
individual investigators do or should proceed from one end of it to the 
other in any particular study. In some cases an experimenter is pon- 
cemed only with delineating important variables/ he enters, at A and 
leaves at B* In some, cases t^ variables may have been de- 

rived already (or it may be claimed that they are known) and the process 
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Sxperiment 



Screening Enipirical study Mechanism 

KNO^<€,EDGS 

Fig. 2 Phases of experimentation 

“begins at B and perhaps ends at C, or it may go on to D. Or having 
“begun at 3 it may “be necessary to go “back to A “because it may “become 
clear that the in^ortant variables are not laiOTvn. In differing con- 
texts all points of entry and exit are possible and relevant; "re- 
tracing steps" and "doubling back" will frequently occur and the phases 
we have distinguished may be less distinct. It can be argued that a 
fourth important phase is the transition from (ii) to (iii). As has 
been illustrated, for exanple (l), by careful consideration of the re- 
sults of an empirical study ideas tending to the development of a 
theoretical model can develop. We here regard this important process 
as part of phase (iii). 

We shall now briefly survey these various phases of study in the 
light of the iterative situation we have mentioned and consider what is 
known of statistical procedures which are appropriate to assist their 
progress . 


4 . GCREEKBJG SXPmMSNTS 

In the study of the distance s fallen by a solid body in vacuo in 
time t, we needed to discover that the variables u, v etc. were not 
affecting s and need not be considered. The situation is illustrated 



All the change in s is occurring in the direction of the coordinate axis 
t. No change is occurring in the direction which represents u, v etc. 
We can fix the value of u and v (corresponding to taking a section 
through the model at some point parallel to the axis of t for any values 
of u and v) and the graph of s against t is unchanged. 

Clearly the problem at the 'screening stage of an investigation is 
that of probing the space to find those directions in which redundancy 
occurs. In this example where experimenteil error is of no importance 
it would be a siuple matter to devise experiments which would do this 
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at least superficially. for systems as clear cut as th|.s various 

devices such as dimensional analysis might he en^loyed to help the pro- 
cess along. 

Suppose, however, we are confronted with a situation where; 

i ) very little theoretical Jmowledge of the system ms available ; 

ii) experimental error was large; 

iii) although there was a large nmher of variahles which it wps 
mi^t effect the response (perhaps 10 or even more) it was felt, 
unlikely that more than a few of these (perhaps three or less) 
would he of any real inportance; 

iv) only a limited experimental effort coul4. he justified; 

v) there was no overriding necessity to keep the escperimental program 
simple, and consequently large numbers of variahles cpi^d he 
altered simi;dtancQUsly in the same group of experiments . ^ 

Two procedures are known to. m which in some cases at least vj-buld seem 
to he aimed at the splutipn of this problem. The first usually utili- 
zes fractional factprial designs and the second the random halanp,e ,.^^^^^_^ 
designs proposed hy Satterthwaite . The details of the latter procedure 
have yet to he puhlished so I will concentrate on the first. 

Bearing in mind characteristics (11 ) and (iv) and (v) of the 
screening situation, it seems we must use. a design ’vdiich, for a given 
total number of phseryatipns, \Till give maximm possible accuracy for 
the estimation of the effects, of the variahles It is known that this 
property is enjoyed by designs for which ali the variahles arp included 
simiiLtaneously and for which there is a high degree of symmetiy in the 
space of the variables. It is enjoyed in particular by factorial 
designs and ffactional factpri^^ where, ,t^^ attained may 

be thou^t of as arising from so called "hidden replication".' For 
large numbers of variables it . will^i^ general be true that cpp)lex 
relationships which Involve all the yariablps p§nnp 

v/ithout a large number of experiments. For exampie, %'Jhere the function 
can be represented by a polynomial in which terms of order higher than 
d are omitted> the series will contain (k + d)l/(k)l(d)l constants and 
we should require at least this number of obsei^ations tp estimate all 
of them. 

We might proceed, however, by using designs which, although in- 
sufficient to. estimate separately all the constants .if thg^^^^^ group 
of ten variables were inportant, would nevertheless be a^eci^te to 
estimate all the qpnstants of say first and second order* assbciat.e<i 
with any particilLar small group of variables if the remaining variables 
were unimportant . " ^ .... . . ........... 

Now although the two-level fractipnal factor^^^ 
satisfy this criterion, since estimates of "quadratic effects" are 
always confounded with each other a^d with estimates of ... t^ so 

that we may wrongly tag as redundant a variable which happen 


FOOTNOTE; * V/e can . of course , easily imagine functions which far 
too coirplex to be represented by anything so siirple as ^ equation of 
second degree even locally but provision (iv) above u^ to take 

risks. 
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passing through a maxiinuin and which does not interact with any other 
variable, yet this contingency is remote and the designs are in fact 
of considerable value for the purpose in hand. Their value is still 
further increased by the addition of centre points • By this means 
the designs are made to supply at least an ’’overall'* measure of 
curvature and some rough indication of experimental error. 


With fractional factorials, or indeed with any design that can be 
devised, ambiguities of interpretation can arise. However, usually we 
will have fairly wide choice of the particular fractional design to be 
employed and it will be possible so to arrange matters that estimates 
of main effects and interactions are not associated with other esti- 
mates thought to be of importance. The designs also have the great 
advantage emphasized by Davies and Hay (2) and Daniel ( 3 ) that a first 
fraction can be a "block" in any one of a set of larger fractions, the 
choice of the second fraction being decided from the results of the 
first. For a screening investigation employing fractional factorials 
therefore the iterative process proceeds somewhat along the following 
lines : 


Conjecture : 
Design : 


Experiment : 
Analysis : 


Conjecture : 
Design : 


Only three out of ten variables are likely to have appreci- 
able effects . 

Use fractional factorial avoiding aliasing main effects with 
two factor interactions which seem likely to be important 
and with a view to the possibility of making this design 
part of a more extensive fractional factorial . Include 
centre points. 

Perform appropriate design in random order. 

Some method of indicating plausibility of various possible 
explanations of data (such as Cuthbert Daniel *s half -normal 
plot (3)« Explanations based on (i) simple redundancy 
(ii) redundancy after transformation (iii) redundancy after 
transformation and/or omission of wild observations, particu- 
larly considered. General inspection which mi^t suggest 
ideas not originally in mind of great importance. 

Based on those explanations of the data and on those new 
ideas which were judged "important". 

Arranged so that rival plausible conjectures co\ild be 
separated and "important" explanations further confirmed. 


Some remarks on this process may be made. The function of andysis 
in the scientific process is to facilitate consideration of the data 
in the light of all possible explanations of it. We shall in this 
particular stage of experimentation have special interest in detecting 
which of the variables are redundant. VJe should not allow this primary 
condition to impede proper inspection of the data from any other view- 
points that might suggest themselves however. The question of redun- 
dancy itself must be broadly viewed. As Daniel has emphasized a fuzzy 
picture can often be brou^t into sharper focus by a suitable trans- 
formation of the data or by omitting certain of the observations which 
may have been in error. His "half -normal plot" analysis provides a 
valuable way of surveying the possibilities. Other methods might be 
employed. For example an electronic computer might be programmed to 
calculate values of likelihood or "significance" associated with a very 
wide range of possibilities (for the problem discussed It might calcu- 
late some measure of plausibility for the ten 9~variable redundancies, 
the forty-five 8-variable redundancies, the 120 7-variable red-undancies 
etc. and the same for various transfoimiations and for different possible 
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omissions of obsoryations ) . It might then retain for report of 
those haying more than a given degree of plausibility. 

The question of whether the hypotheses considered in the analysis 
were in mind when the experiment was planned is of course quite irrele- 
vant in the present context. It is never true, that we are bar^ 
deducing new hypotheses from the data for test in later experimentation. 
If that were so no progress would be possible. 

In Judging the inportance of possible explanations of the data the 
measure of plausibility is one of the things which must be consI^®^®^> 

however, at least, two., other ..elements ,mus.t ,.,,alsg...ba.,..t.a3ce^^^^^^^^ 

the planning. of further action. First the experimenter must consider 
whether the .effects observed dp ,0 not agree with what he feels to 
be reasonable. If a hypothesis which seemed contrary to all reason 
were thrown up as likely the experimenter woiild rightly require further 
evidence before hp believed it. Second ^ must^ consider 

the observed effect in relation tp its possible utility. If the reality 
of an effect is in no real doubt but its d.irectipn is such that it . can 
be of little value, it will receive less attention than a less plausible 
effect of potentially higher utility. 

Comments on the formulation of the screpning problem 

Two comments are appropriate concerning the general formulation of 
the screening problem; 

First, it should be noted that the problem, as stated, is concerned 
with the detection of redundancy of rather a special kind «• n^ely redun-^ 
dancy of the variables when they are considered in the, part ictiilar manner 
defined by the experimenter. In practice where there are say 10 vari- 
ables which may affect the response we may well find that perljiaps half 
or more of them are redundant in . this seps^^^^^ turn out 

however that redundancy of different kinds will occur among tlie remaining 
variables. 

For example in a problem in which the response "yield" depended 
only on the ratio of two concentrations the particular decision to con- 
sider the separate concentrations aa variables .and not 
consider "ratio of concentrations" as one variable and "overall. concen- 
tration" as the other would mean that no redundancy would be found. To 
quote a second example, it might be that in a cake -mix only one variable, 
the acidity of the mix, was really affecting a certain response . If this 
were so, all variables which, affected acidit would be found to have 
effects, although by making suitable transformations of tbe v^iables 
these effects could be reduced to that of a, single variable, - Geometri- 
cally this means that we are searching the space for redundancy only in 
those directions parallel to rather arbitrary coordinate axes;, 

A second point which shovild be.,npted is^ t^^ 
the solution given is dependent on the applicability of the assumptions 
(i) that only a limited experimental effort can be Justified e^id (ii) 
that a rather complex experimental program can be run . 

There are certainly very many practical situations where;; these 
assumptions apply, but there are other siti^t ions where, provided the 
experimental designs enployed are simple and do not involve too many 
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of the variahles simultaneously, a continuous program of small varieties 
of process conditions may he installed as part of the normal production 
routine. This method of “Evolutionary Operation” has been described in 

(M. 


5 . EMPERiay:. subface study 

The problem at this stage of experimentation is frequently to find 
optimum process conditions and to describe the behaviour of the response 
function in the optimal region . The latter part of this sentence is 
emphasized because knowledge of the position of a single optimum point 
is seldom satisfactory. This is because (i) knowledge of the local 
behavioiir of the function is essential to allow intelligent operation 
and control of the process, (ii) to allow recalculation of optimum con- 
ditions when external features, such as prices of raw materials, change 
we must know the local behaviour of the response function near the pro- 
visional optimum, (iii) usually the problem involves not one single 
response but several responses (cost, purity, colour of product, physical 
form of product etc.). To arrive at a satisfactory compromise it is 
essential to know the local behaviour of all the response functions in 
the optimal region. 

To allow progress to be made in this problem, iterations of 
different kinds occur simultaneously: 

5.1 Iteration in position. 

The results from a group of experiipents may be eii^loyed to tell us 
where a further group of experiments should be performed, so that the 
second group is closer to optimum conditions than the first, or so that 
it straddles the region of interest more satisfactorily. This is essen- 
tially, a process of iterating in the position of the experiment in the 
space of the variables. Examples of experimental procedures which do 
this are the one factor at a time method, the method of steepest ascent, 
and methods of surface study which en^loy canonical analysis of fitted 
second degree equations. The reader will have no difficxilty in dis- 
tinguishing the components, ’’conjecture”, “design", "experiment”, "ana- 
lysis” in such procedures. It will be noted that in practice "steepest 
ascent" and ’’canonical analysis" are both exairples of dynamic processes 
of analysis leading to formulation of hew experiments. 

5.2 Iteration of scales, metrics and transformations 

Not only must we iterate on the position at which observations are 
made in the space of the variables but simultaneously on the way in 
which we choose to consider that space. Thus Initially the experimenter 
might propose a two-level factorial experiment in which temperature was 
changed by fifteen degrees and time by three hours, thus implying that 
at this stage of the investigation at least he regarded these changes 
as in some way comparable (and consequently that if the response surface 
were visualized it ought at this stage at least to be visualized so that 
differences of these magnitudes were represented by equal distances in 
the space ) . Resxilts of the first group of experiments might however 
very well suggest either or both of these scales had been poorly chosen 
and that they should be made wider or narrower in the next group of ex- 
periments , 
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Again, a group of resxilts might surest that the metric associated 
with a given variable was capable of , iii 5 )rovemittt . This is to say they 
might suggest it t/ould be possible to represent changes associated with 
that variable more sinp and more accurately in terms of som4 trans- 
formed quantity such as its logarithm or reciprocal. It is |n fact 
possible to set out designs which facilitate the discovery of the most 
adequate metric ♦ As a general rule we would wish to avoid becoming 
involved in an elaborate form of equation where a simple f orm woxald be 
adequate with modified metrics. If possible, for example, we would 
try to oise a first degree equation with modified metrics rather than a 
second degree equation. Similarly, we wo\ild try to avoid the necessity 
for cubic equations where second degree equations with modified metrics 
would suffice. The problem of how to design the experiments and to 
carry out analysis so as to be led to the most useful metrics is one 
which is under current study. 


Finally, there is the choice of transfomation of the variables 
where these transformations involve mpre than one yariable. i^Xt is 
frequently the case that the response is not most simply expressed in 
terms of the natural variables such as time, temperature, concentration 
but in some compound function of them. In the neighbourhood of a maxi- 
mum the redundancy among the variables studied is usually evidenced by 
the existence of ridges in the response surface. Study of the response 
function (for example by canonical analysis) often leads to re-metrici- 
zation of the problem in terms of a few new variables which are coapound 
functions of the more numerous old yaria^ 


Thus initially we might be working in terms of variables Xj^ and x^ 
in terms for which the response surface might be a ridge maximum like 
that shown in Fig. 4a. A 22 factorial in this space would be represen- 



in which the; metrics were changed and transformations introduced, we 
might finally end up with a space defined in terms of new variables 

^2 “ ^ 2(^1 which the response surfac^ will take 

on the more symmetrical shape shown in Pig. 4b. A 2^ factorial in this 
space is indicated by the crosses. We notice that the ” well, designed 
experiment" in the first space becomes a "very poorly designed experi- 
ment” in the second space and we see that in fact the concept of "good 
design" is entirely relative. In any absolute sense etn arrangement of 
experimental points cannot be said to be good except in relation to its 
power in elucidating the response swface. But .since m 
what the response surface is like until we_hav some experiments 

we must necessarily follow an iterative procedure in which we; try to 
get a glimpse of the surface and then modify ovx approach depending 
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upon what we see. It will not he until towards the end of the itera- 

tion that we are in fact getting arrangements of points which are 
ideally situated for the elucidation of the surface. In the same way^ 
any procedure which we use for analysing the experiments must be based 
on o\ir best understanding of the situation at ihe time. Thus, for exatrqple, 
as Dr. Wilson and 1(5) emphasized in oiir original paper, the direction 
of steepest descent depends on the particiiLar scales, metrics and trans- 
formations chosen to describe the space of the variables. At any given 
stage, the direction of the steepest descent is the best direction of 
advance in the light of the best information available at the time as 
to what are the most reasonable scales etc. in which to consider the 
variables. Like every other process in experimentation it has no ab- 
solute validity but is as good as the auxiliary information allows it 
to be. 

5.3* Iteration on the model and the design 

Since we usually wish to conserve experiments and to make inter- 
pretation as slnple as possible, we should begin by making the sinplest 
assuirptions we can. At the same time we shoxild choose the experimental 
arrangement so that a warning will be provided when a more elaborate 
model (and consequently a more elaborate design) or more replication 
(hidden or direct) is likely to be needed to make further progress pos- 
sible. Thus in practice we mi^t begin by performing a sinple design 
such as a two-level factorial or fractional factorial with added centre 
points, replicating this design, adding other fractions, or a\ign]enting 
to form higher order designs as appeared necessary. 

5.4 Relationship between numerical and exponential iteration 

It is of interest to notice how closely the iterative experimental 
procedure we have discussed matches iterative procedures for the solu- 
tion of linear and non-linear equations (6). If we have to solve a 
set of non-linear equations such as 

fi(xi 'Xg) = 0 

the problem is equivalent to that of finding a stationary value of the 
function '^(xjL.Xg) where 0 is chosen so that and are 

its partial derivatives. The contours of the function ^ in the space 
of x^.Xg may then very well look like those shown in Fig A a and itera- 
tive methods for finding the solution of the equations are analogous to 
the methods of experimentation which we have discussed. In particular 
the one factor at a time method of experimentation is similar to the 
Gauss process for the solution of the equations, the experimental 
method of steepest ascent has its corresponding counterpart in the 
steepest .ascent nxnnerical method of Booth (6 ) and the experimental 
method of using a locally fitted second degree equation is analogous to 
Koshal*s method for fitting curves by maximum likelihQod,( 9 ) * 

6 . THEORETICAL l^CH^^ISMS 

Either after a number of clues have been provided by resTalts of 
empirical experimentation such as that described in the last section, 
or sometimes without such a preliminary investigation, it may be pos- 
sible for the experimenter to conceive a theoretical mechanism which 
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might describe the phenomena vhich are being observed. Thus, in 
chemistry, kinetic theory may provide such a mechi^ism . From^ a jiathe- 

matical analysis of this hypothetical mechanism it wiil then usua;Liy be 
possible to produce some theoretical functional form which shot^d relate 
the observations to the variables. Thus consider a siirple chemical 
exan^le in which a reactant A was^ decomposed to form B which was then 
subsequently decon^osed to form C. With y^^, y^ and y 3 representing the 
yields of A, B and C at time t upder certain ass^miptions 

the following set of differential equations represent the system: 

(1) ^ = Vi - Va 

In this particular example(althoiigh not usually) an escplicit solution of 
the differential equations is available, for example, the yield yg of 
the intermediate product B at any given time t is given by 

(2) yg = 

Suppose that the results of a nwiber are available. In 

this case for example y^ would have been observed at various values of 
t. The problems then are (i) to discover whether the assTimed functio- 
nal form is adequate to describe the data, and if it is not in what way 
it is not; (ii) if the functional form does fit the data to estimate 
values of the jumte parameters (l.e. the constants and in our 

exaii 5 )le) and to determine their precision as measxired by theif standard 
errors and confidence region. Recent work undearbaken on this 
problem (7,8) has shown that by using the nxamerical methods if. is pos- 
sible to set up a general program on an electronic con^uter which will, 
by an iterative process analogous to the experimental process’: we have 
discussed, answer all the questions posed above and furthermo;^e. that 
this cap >e done w^^ the fimctional form is given explicitly as in 
equation (2) above or inplicitiy as for example by the diffefl^ 
equations (l). 

It is found that such a program can be of great value in ' the formu- 
lation of theoreticeO. mechanisms ♦ The experimenter may start off with 
a theoretical model which he feels is almost certain to be inadequate 
but which will at least crudely describe the process involved. i\na- 
lysis of the "residuals”, that is to say the discrepancies between the 
observed and calculated v^ues when the ^ b fit has been ob- 

tained, then enables him to see in what way his first atten^t” at a 
model needs to be modified With the model suitably altered a second 
set of calculations will then be carried out on a computer. If this 
model is again found Inadequate the nature of the inadequacy is studied 
and this again leads to fvutiher modification of the mpdel. In this, 

\ra.y finally one or more plausible mechanisms may be found wiiicH aSe^ 
tely describe the data already available. It will be realised 
such a process need not lead to a correct model but only to a formula- 
tion which is descriptive of the data already collected. lb is now 
necessary to set the computer a new task, that of designing experiments 
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which most severely test the model so far postiilated. We thus set up 
an iteration of successive analysis and design which together can lead 
to convergence on the correct model. 


7. CONCLUSIONS 

VIhat morals, if any, can we draw from this discussion? Some of 

these are as follows: 

i) Different situations require different techniques and major attri- 
bute of a good statistician should be to recognise the different 
situations and to have available the different techniques. 

ii) Much experimentation is iterative and it is the statistician’s 
function to assist this process. The iterative nature of the 
process must affect his attitude both to. design and analysis, 
and to such specific things as significance tests. 

iii) A strategy of experimentaticp for continuous variables is only good 

or bad in relation to the surface which is explored. Thus, as has 
been so well brought out in the paper by Mcilrthtir and Heigl Q.'cJ, 
performance on the black box assesses a strategy not in relation to 
its absolute value but in relation to the surface which is in the 
box. Because of this the iniportant question we must ask is what 
sort of surfaces occur in our particular type of work? li^en we 
know this we can devise a strategy which wi31 be appropriate. The 

particiilar techniques of experimentation which I devised in coopera- 
tion with Dr. Wilson and others were themselves very much a product 
of the iterative process. We tried something and if it seemed to 
work we kept it and if it did not we rejected it or modified it as 
seemed appropriate. The emphasis which the second order part of 
this strategy places on canonical analysis etc. is syirptomatic of 
the fact that the major characteristic of the majority of surfaces 
which we studied was the existence of ridges or, to express it in a 
different way, the occurrence of redundancy or partial redundancy 
not in the variables as studied but in functions of these variables . 
Such experience as I have had in other areas has led me to believe 
that this phenomenon may be fairly common . The inportant thing is 
clearly to make a study of the types of surface which occur in 
practice. So far as chemical problems are concerned, this we have 
tried to do over the past six or seven years in two ways : firstly, 
by noting the types of surface which have arisen in as far as they 
can be elucidated by the techniques we have used; and secondly, by 
studying the characteristics of theoretical surfaces. With the 
available modem computing equipment with which differential equa- 
tions can be readily integrated using numerical methods, the eluci- 
dation of a wide variety of surface types can be accomplished. 

iv) A point which we have not been able to discuss fully in the body of 
the paper is that in practice few problems of optimisation are 
concerned with a single response. Usually there are a nimiber of 
responses such as yield, purity, colour, physical form etc. and, 
although in theory we could combine all these into a single crite- 
rion of value or cost, this is in practice not a useable procedure, 
for it requires the equating of incommensurable qiiantities. 
Questions like: How much does a bad smell cost? At what cost 
shoxild we assess the blowing up of the plant? How often can we 
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kill all the fish in the river? etc. are not easy to answer. A 
practical solution of tlie problem which we have adopted is that of 
maximising the principal response such as cost subject to a series 
of restrictions necessary to keep the other responses at satisfac- 
tory levels, A procedure analogous to linear programming is then 
employed, 

v) In the response surface problem, what is usually needed is not Just 
the position of the rnaximm but also the native 

this neighbourhood. The existence of insensitivity to changes in 
specific direction (i.e. ridges) often make it possible to find 
manufacturing conditions which are near optimal for several respon- 
ses simultaneously. 

Vi) A point which must not be lost . sight of is the critical In^ort an ce 
that an experimenter’s knowledge of the problem plays in any 
experimental process. I have always felt that the statistician 
has at least as much and possibly more to learn from the good 
experimenter than the experimenter has from the statistician. In 
the process of investigation we have described, the experimenter’s 
mind must be in the circuit of iteration particularly at the ana- 
lysis and conjecture stages. This means that the statistician’s 
analysis must be so expressed as to be clearly comprehensible to 
the experimenter and it must be such as sp far as possible to pre- 
sent all the facts in an un distorted way. The statistician must 
remember that it is auite possible that the experimenter will see 
things in the data which he cannot see because of his la.ck of 
special experience in the field concerned. Therefore, he must not 
filter pieces of information which he feels are irrelevant ^^b^ 
which in f act inay be critical. The experimenter must be given 
opportunity to assess the data in relatipn to hypotheses other than 
those which are in the statistician’s M ! 

vii) The process we have described is rather like the operation of a 

servomechanism and the rules for good operation are similar to the 
r\iles for good operation of such a mechanism. For exanple, for 
efficient operation of such mechanism the signal to noise ratio 
imist be reasonably high, otherwise the system will be unstable . 
Considerations of the plausibility of various hypotheses should be 
thox^ht of in this regard rather than in terms of formal signifi- 
cance tests. 
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STA3J1STICS, QUAUK, ASD COTOtOL; 

THB ;/ 

Riissell V, Jpiins^^ 

The Johnson Gage Coagpany 

On an occasion suoh as this, vhen ve az« the Twelfth year 

of the Aiaerloan Society for Quality Control^ we ml^t he given good 
cause to reflect on the purposes and, more than that, the achievements 
of 5QC as applies directly to each and every one of us who believe In 
and practice this Bclenoe. There are those us who can i^lnt to 

successful epdeayprs^^ 1^ applying cm SQC program within our plants, to 
real results of ecpnpmlc value and prof it to oihr organizations', and to 
genuine contributions to our constantly advancing Industrial yay of 
life* But, undoubtedly, there axe also among us those who haVe been 
frustrated In attSiCPts to apply statistical means to better production 
rates, lower costs, and Increased g^uallty of product* And, it Is prob- 
ably correct to state that there are a dangerous number In the latter 
category who, for one reason or other, have been unable to effectively 
establish an SQC program In their Cfwn plants* 

Far be it f r<p the^ w that there Is a siapll solutl^^ 

to the SAny problems. Involved getting an SQC program to wo:^k« But 
It appears that In a great many Instances we have forgotten, dr at 
least neglected, the intended practical aspects of this modern product- 
ion tool; that we have became lost In ^ t^ of chaz^s graphs, 
thwarted by 8 misunderstanding of our intents, and befuddled 

by the political aspects of ''•*lt was good enough thirty yearC ago, so 
why try to make It bet^ 

It Is not the intent of this paper to attempt to remedy aH of the 
problems encountered In trying to get a sound, sensible SQC program In- 
itiated in any of your plants, hut perhaps If we will consider the basic 
fundamentals we will better arm purselyes toward the wet out 

of Statistics, 'Qu^it Control*.. , ''”1 

It is the humble opinion of the writer that an^i^ 
power exists In most plants where SQC Is only in attested op|ratton* 

It la his opinion that the unequal or, should we say, the unrealistic 
attention, either excessive or Inadequate, upon any of the three basic 
principleB of SQC is one of the main causes for tt^e unsuepfs appli- 

cation of w SQC program* 

The main theme pf this paper will deal with the coupling of effec- 
tive Instrumentation with practical statistics as an absolute^ necessity* 
Because of the writer's personal backi^ound concerned with thp field of 
screw thread measuring devices, much of this paper will concern Itself 
In that field* various neins by which a screw thread may he meas- 
ured win be discussed purely from an objective standpoint, and it will 
be pointed out that effectlye instrumeht-atW^^ an integral 

hut a mandatory factor in any Statistic^ Quaii% Control operation . 
Finally, it Is the opinion of the writer, and others in his field, that 
proper Instrumentation has been sorely neglected by those who are dir- 
ectly concerned with the statistical Pf product quality to the 

degree where-hy this entire movement in wiferp production has been 
seriously endangered. 
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Tbe writer does not claim to be a statistician althou^ he does 
have a fair working knowledge of most of cvorrently p<^ular mathem* 
atlcal bases used in SQC today. Being a mexober of the gage^making in- 
dustry, it is only fair to state that it is none of our business to try 
to state whether or not your product is acceptable from a quality stan« 
dard, we are solely charge with designing equipment which will tell you 
Just what your product actually is from a qualitative stand^int. There 
then remains the factor of control which is, we feel, directly related 
to the coupling of proper and effective instrumentation with proper 
statistics. 

Let us, for the sake of clarification, review the three basic div- 
isions as contained in the very title of this paper, namely. Statistics, 
Quality, and Control. 

For many years before these words were Joined as in the name of a 
process or an organization, industry was attempting this concept. It 
was shortly after World War I when a statistical application to inspec- 
tion methods was first started but this specific title was lost for 
many years, even thou^ it was practiced. Since approximately 19^0, 
there have been upwards of fifty different statistical approaches and 
theories esqpounded. In fact, if one will note the articles published 
here for this Eleventh National Convention, there are even newer app- 
roaches throu^ applied new statistical concepts. Actually, each type 
of industry. Chemical, Textile, Rubber, Metsl-working, Pood Packing, 
has its own unique statistical approach toward the control of product 
quality. There are charts, diagrams, distribution curves, all too 
numerous upon which to elaborate, and there are most likely at least 
a half dozen in each group to meet the needs of evezy Industry today. 

We do not infer that we have yet come upon the most fool-proof, the 
most practical, or the sisqplest statistical devices, for we must strive 
to better each system, to determine its flaws, and to ascertain if it 
is too cumbersome to effectively cerate in our own situation. We do 
not make the Inferrence that there are too many statisticians in the 
world today, but it is the writer* a personal knowledge that there asre 
plants today where SQC is no more than a group of very well conqpiled 
charts and data sheets, where the Queility Control Department is like 
a department of hi^er mathematics, where for certain (sometimes per- 
sonal) reasons the director of the SQC pro^am occupies a chair in the 
proverbial Ivory Tower. Nobody can criticise him because nobody can 
understand his mathematical genius. This is a harsh statement to make, 
nevertheless it is known to be true in certain instances. Summarily, 
although we realize that there is a definite need for Statistics to 
simplify procedures and to corroborate more complete data, there cannot 
be placed too much emphasis on statistics alone. It is not the intent 
of this paper to place discredit upon those whose profession it is to 
devise these mathematical concepts which can be practically applied to 
facilitate production and inspection, in fact, that would be as far 
from the truth as anything could be, but we do wish to point out that 
UNLSSS we can effectively couple a sound statistical basis with eff- 
ective Instrumentation we will not meet with managements requirements 
for producing better product at lesser cost • It ccmnot be done with 
statistics alone. 

The direct result and most intangible aspect In SQC is Quality 
itself. To borrow a mathematical term perhaps it would be safe to say 
that quality itself if the biggest variable. There are too many 
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factors vhlch Influepce tlM quality of tbe final product. First of 
all, va are dependant upon our maeliine or manufacturing capabilities 
because statistics and instrumentation will not make parts cJone, the 
machine must mahe them* Obviously, one of the first steps to consider 
is the capability of our manufacturing processes and pur inspection 
equipment* From there, ue must ascertain the quality level ve must 
maintain in order to meet better competition from a quality stand-* 
point* Doubtless, most sales departii^nt complaints hinge on inferior 
quality, or on a delayed shij^nt caused by rejected imstierial* Qi^ 
side inf luences such as custonmr competitive quality 

and price, cause us to attesgpt to set a level* Theee external factors 
and other influences are not to be discussed ^ of this sort, 

but we must realize; that once a quality lev^^ whether "th^duj^ 

external or internal means, or both, it then becomes the tash of app- 
lied statistics and effective instrumentation to garantee that we will 
meet and hold these desired and denw^d levels* ^ 

This brings us to the subject of gaging and/or instrumentation as 
It must be applied in an SiVC program if that program is to res^ its 
full benefits* 

First of all, we must define the purpose of gaging* We might first 
define a gage, what it is, and what is its intended purpose* One mbx^ 
popular definition o^^ gage is that ''it is a device de:l||iLinirig 
accuracy and inter-changeability However, there is an implication 
in this definition that a gage is not and should not be Ppesidered ^ 
having any aspects of control over the part being produced* Obviously , 
we must not allow ourselves. In this mo^^ day, to interpret or de- 
fine a gage as being singly a Jud^ of whether or not a part is good 
or bad, aeceptable or rejectable. We do not wish to make unfair or 
unreal statements ..or; ,8ug^ as, to .tbe..,.effectlveniM,,.pf 
Inspection operation either, for it is an integral part of the quality 
determining factor of items about telte the manufacturing 

plant* But now that we have gone throu^ an era where we havb come to 
realize that quality cannot be inspected into a part, it must be built 
into it, a ge^ then becomes more a device wite which to deteimixw 
the acceptability of final product* A gage now becomes "a device to 
facilitate production and garantee the quality of the itwiis produced*" 
Thus, when used in teis latter d^ position, a gage is ho^ longer 
something which merely inspects, it becomes an integral paart of the 
production apparatus* A gage becomes a tool, homogenous with cutters, 
grinding wheels, etc*, and it is only when a gage is regarded as a 
production-vised tool that its fullest meMim of effectiveness cw be 
realized* We are not attempting to imply that a gage should %e used 
in the same manner as most tools are used, partlcul^ the psy- 
chological stecdpoint wl^re tool adjusteent Dorw variation 

in product dimension* Bather, a gage must be used for the pusi^ose 
for which it was designed, often with care reipeet* 

A piece must be ffee from foreign matter to a reasonable degree when 
it is inspected, and gage must never be forced to fit t^ 

The gage becomes the msehine second brain, his sis^h sense, 

helping him to Judge when his equipment must be re-set or, sometimes, 
when the operation must be stopped altogether. It Is still t|ie unfor- 
tunate condition in plants today where both management and oper- 
ators rec^d ga^s as negative :iiiq>lement8, policemen to^make ap 
arrest in a punitive fashion, penetlizers, and deterrents to hl^ pro- 
duction* A gage, conversely, is far from that, when it is a correct 
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gage from tbe staodpoint of design and cost* Correctly used, it Is the 
operator's biggest aid in helping him to keep his machine running at all 
times 8Q that he can get a maximum of acceptable product output vith a 
minimum of down time and rejects* Unfortunately there aie instances 
where management is guilty in opposing effective gaging practices be- 
cause they do not realize that gages, correctly designed and used, will 
increase (not decrease) their output* Then too, management often times 
has bad experience with unreasonably expensive Inspection procedures 
and has returned to antiquated and supposedly less costlby inspection 
devices which aare actually the most costly items which could be used* 
Regarding the cost of inspection, management often forgets that it is 
not simply the cost of the gage itself but the cost of the inspection 
operation expressed in terms of (a) time for the inspection operation, 
(b) wear factor on both operator and gage alike, and then (c) the 
cost of the gage itself* Obviously, it is the sum total of these three 
factors which must be considered in effectively selecting inspection 
equipment* 

With specific regard to the manuf€icture of threaded product and to 
the gaging of screw threads, how can effective instrumentation ally 
itself vith statistics to assure the quality level of manufactured 
product t 

We must bear in mind that the ultimate in a good statistical plan 
is to inspect a minimum number of pieces and to determine, by the re- 
sults of the inspection process, the qvaJAty level of the items being 
produced* Obviously, there are natural defects within any sampling 
plan* True, much has been done to eliminate this chance factor, but on 
a purely mathematical basis there are still areas in which, through 
natin^al mathematical law, complete accuracy cannot be predicted or 
expected* Taking this fact then, and recognizing that there are limit- 
ations inherent In even the best of statistical sampling plans, we must 
minimize the effect of faulty or Incomplete inspection methods, of gage 
error and of observational error, since these would only tend to mul- 
tiply the error In the system* It is axiomatic to state that the fewer 
pieces inspected (and this is the ultimate of an SQC program) the more 
critically they must be inspected* Ac example of this, although not 
too practical, might be a run of screws from a particular machine to 
which we wished to plot an X and R Chart* Let us further assume that 
we were going to divide our chart into increments of *0001** graduations* 
If w« were to measure the pitch diameter of these screws on a dial 
indicator type coosparator, would it be correct to use a dial which was 
graduated in *000$*' increments 7 Obviously not, in fact, when we 
couple this effect we would be very lucky to wind up with aiay kind of 
authoritative chart; it would probably resemble a proposed trans-con- 
tinental twenty lane hl^way laid out vith a very dull pencil* 

Tbe above cited example is in no way intended to give an over-sim- 
plified answer to the problem of correcting all approaches to the meas- 
uring of a screw thread* Yet, we feel that there are many instances, 
not only in the field of screw thread measurement but in other fields 
as well, where the basic fundamentals of instrumentation az*e so thor- 
oughly incompatible vith control chart requirements as to render the 
actvial inspection operation completely ineffective* Dealing specific- 
ally with threaded product, we will discuss the various means by which 
a screw thread mij^t be inspected and point out the merits and limitat- 
ions in the various basic types of gages used today* We felt that we 
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could iopcurtlally discuss these various types of gages aud systms for 
over the fifty years practically every major develppment in the 
field of screy t^^ chepl!4.ng has come from our ccmpany* 

Genercdly regarding externally threaded product, the Go ihread ring 
gage Is usually given as the criteria for assemble rah lllty checking of 
a male threaded part* This gage is actually a functional^ or cumulative 
check which theoretically assures that the combination of errors in the 
thread, the lead, pitch diameter, angle, out of round, taper, etc*, is 
such that the part will assemble with Its^ !^ female thread which 
would be effectively no smaller than the Go ttoead ring gage* Purely 
fr(mi the standpoint of assemble-^ability, the correctly made add unworn 
solid Go thread ring gage serves this pvirpose f ully* We are complete 
accord with the gaging philosophy that all other devices for measuring 
screw threads cpaulatiyely must eventually square and agree with the 
solid Go thread ring gage. Yet, there are certain factors or 'defects 
in manufacturing proeesses which can never ht detected thro]^ use 
of a Go thread ring gage* What about a condition of out of round, of 
off lead, of back (or front) taper X Obviously, a fixed gage, such as 
a Go thread ring gage, will not reveal these defects* Wi^ musi beer in 
mind then that the Go ring gage can do nothing more than to tell us the 
maximum effective size of the part, its assemble -^ability, and should be 
regarded solely as such. The prime limitation of the Go thread ring 
gage, aside from the fact that it la merely an assenible-abili'ly check, 
is its high cost of use from the standpoint of time and wear*! It is 
extremely uD-*econcmitcal and impractical for use in a hi^ production 
area* 

A second type of Go threeui gage is the Roll Snap Gage, pioneered 
and first manufactured by our company in the early 1$20'8* This gage 
consists of a pair of annular ribbed rolls mounted on eccentric pins 
and is an extremely economical gage to use due to its long lli^e, fast 
action, and liberal adjustment. However, from a purely technical aspect 
this gage is quite inadequate as it gives a diazoetral check in one plane 
only for pitch diameter, lead, and angle* It is a linear contact gage 
only, and is incapable of detecting thread drunkeness, a poojrJ^ staging 
thread, and sometimes out of round, as it only engage the pai:^ being 
inspected at two points, IdO* apart from each other, and in ohe plane* 
Furthermore, unless the float or axlid movement is L 

restricted it would rardly detect off lead or irregular helix* A Roll 
snap gage should never be used without a simultaneous spot-check with 
a Go thread ring gage. 

Another type of Go gage in use today consists of two opposing flat 
anvils upon which a stral^t line thread form has been generated* This 
type of gage shares the limitation of the Roll Snap Thread Gage in the 
fact that the gaging elements are located in one plane only* This gage 
does not wear as well as the Roll thread S^nap Gage, however* 

A third type of "fixed” gage is the Ring -Snap Gage which embodies 
the "snap” action principle of the two above tnehtlo^^^ gages, but which 
consists of threaded segments which engage the part peripherally, ^ 
as a ring gage does* Technically, this gage shaz^es the features of the 
ring thread gage with the economics of the Roll Snap Ga^e* Tbe gaging 
members are mounted on eccentric studs for easy adjustment an|i the seg- 
ments out-wear ring gages many times over* 
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The aforementioned gages constitute the more popular present day 
means by which external screw threads are mecusured on an attribute ba- 
sis for assemble -ability. As previously stated, fixed (Go) type gaging 
Is generally regarded as the final criteria for acceptance or rejection 
of product at maximum assemble -ability limits. But while we are concer- 
ning our remarks to ”0o” type gaging let us, for a moment, consider the 
application of variables type gaging for cumulative (Go) checking of an 
external thread. It would be well to bear In mind at this time that the 
purpose of ”Go” gaging Is to determine assemble -ability. But In this 
modern day we have come to realise that the mere fact that a part will 
"assemble" does not necessarily mean that the part Is good enough. One 
example of this would be a condition of out of round or taper where the 
maximum condition would not exceed the Go gage but the minimum condit- 
ion or size might well be below the minimum limit. In actual assembly, 
a part so constituted would assemble, but would It remain assembled 
when subjected to conditions of stress or vibration ? The entire load 
would be concentrated on the area of maximum size and the chances of 
the part remaining assembled are very slim. By using variables type 
equipment these conditions would be readily detected. 

To discuss briefly the various types of indicating (mschanlccUL) 

Go thread gaging equipment being marketed today, there are basically 
only two types, namely Roll and Segment Comparators* These categories 
ccua be divided into two and three point contact on roll comparators, 
while the segment type comparator Is essentially a two point gage un- 
less the size of the part being checked Is equal to the size of the 
gaging elements. 

The roll type comparator, which engages the part on a linear basis 
In general Is not as critical as the peripheral contact of a segment 
type cQD^arator* A two roll comparator will not always detect Irreg- 
ular helix because It has the same limitation of a roll snap gage, as 
the part being gaged Is gaged only in one plane. Ovality can be de- 
tected In a two roll Indicating thread ccmparator provided that the 
piece Is rotated, but this Is generally difficult to do since this 
usually means that the part must be re -Inserted In the conparator and 
a fly-reading taken. A three (or trl) roll comparator, which engages 
the piece at three places, usually 120* apart, will detect trlangulat- 
lon, but not pure ovality. The three roll comparator Is more apt to 
detect helical Irregularity than a two roll comparator, but because of 
the line-contact features In both conparators there are certain of the 
helical distortions which could remain un-detected, also a poor start- 
ing thread could conceivably be missed using a roll type coiiparator. 
However, regardless of these slight technical limitations, roll type 
comparators enjoy high popularity primarily because of their long life 
of gaging elements and. In some Instances, the effects of dirt and 
other foreign matter are reduced. 

However, we must remember that a Go gage or conparator should dup- 
licate, as closely as possible, the mating part. For this reason, then, 
a se^nt type gage or comparator Is more critical because of the per- 
ipheral or circumferential engagement on the part being Inspected. 

to this point we have concerned ourselves primarily with the 
various means by which a male screw thread might be checked for assem- 
ble-ablllty. We have also suggested that by using a variables type 
gage we will not only determine whether or not a part will assemble 
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vlth its mating part, but ve can finrthjdr detect cei^aln e^^prs tl^oii^ 
tlie use of yarlabXes type gaging which cannot he deleted thr^u^ the 
use of fisEed gaging methods* AIbo, ve have suggested that th]rou^ the 
use of Indicating type paging a machine operator can determine trends 
toward maximum or minimum limits, thus assistihg him for machine and 
seti^ control* But what about ”Not-Go” gaging ? Why should we gage 
for not go, and, in tha case of a screw thread, how can we helt do thist 

First of all, we must recognize that a cQBmK>n screw thread ^ d^^ 
from a plain cylindrical pait in that one cannot use an effective (or 
cumuiatiye ) check at both the maximum and minimum limits • We^ have to 
check the various elements in the ttoead to assuira that a part will not 
only asseaible but will remain asseinbled* We must also ^cognize that 
the tolerances esipressed for a screw thread are cumulative, that is, the 
tolerances for pitch diameter cumulative and include the variations 
in lead and angle* Thus, the full pitch diaineter tolerance^ cjnnipt Jbe 
used unless the lead and angle of the thread are perfect* therefore, 
it beccmies necessary to check the actual pitch diameter of the product 
in addition to the assemble ^ab^ effective size* We must bear 
in mind that the pitch diame^r is actimlly the amount of metal left 
In the screw, and an error in lead will give an effectively ikrger 
reading on an actually under-sized screw. An error of *^1" jin lead 
will give ah effective pitch diameter reading which is *00173 (or 
nearly *002:**) larger than the screw actually is* Further, one can de- 
termine by the process of eliminatipn whe^^^ eleo^nts of 

lead and angle are within tolerance by contrasting the ef^fecilve size 
reading with the actual pitch diameter of the part* It is posslhle to 
check the other main ejaxsents of the thread, namely lead and wgle, by 
other s^^s, but for all practiccl! pui^bses this is usually ihcbhven*- 
ient* Tto simplest element to check Is pitch diameter* Thus, the 
two reasons for measuring pitch diameter are (a) to determine if the 
thread is within prescribed limitB from a pitch diameter specification, 
and (b) because the pitch diaiaeter is the simplest element to check* 

Bow should the pitch diameter of a male 
methods are currently used and which of these means are correct t , 

To recall our definition of npt-go gaging for threads. We are re- 
minded that an go gage should check one element of the thi^ad only, 
namely, the jpitch diameter* Ope of the most cpiiwn, and certainly the 
most incoxrect, ways of checking pitch diameter at the minlmup limit is 
by the use of a not go ring thread gage. There Is absolutely no valld:- 
ity in the lase of this gage since it cannot miea^^^^ diaa»ter 

of the threaded part* An off -lead condition ip part would cause 
the part to bind or be kept out of the not go ring. Therefoxb, when 
this conditipn pccirs, one would assume that the pitch diameter were 
not undersized* Furthermore, a bruised or ”fat” starting thread would 
prohibit the part from entering the not -go ring gage, thereby making it 
an acceptable part* Also, as previously mentioned, back tapir or out 
of round would keep the part from entering the not go ring* Last, and 
perhaps most In^ortaht the theoretical principle of /’gaging by KOT 
gaging” cannot be Justified* Actually, a not go ring gage Cpnceals, 
rather than detects, error in the thread. It gages the thread by not 
gaging it* There is no techpical yalid^^ this concept of gaging* 

In order to correctly measure the pitch diameter of a thread, the 
effects of lead and angle must be eliminated* ^3Phe cone suid yee 
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the moBt suitable and correct means and duplicates the principle of the 
pitch micrometer. This can be achieved by either a pair of rolls, one 
cone and one vee, diametrically opposed on either a fixed or indicating 
gage, or by the combination of three rolls, one vee and two cones, on an 
indicating type comparator. The former principle is embodied in the not- 
go portion of a roll snap gage and in the aforementioned ring snap gage. 
For this reason a roll snap gage is correct at the not-go section, but 
only when the not-go rolls are a cone and vee. We must bear in mind the 
fact that we are attempting to determine the amount of mstal remaining 
in the screw at the pitch line, and not the amount of metal removed from 
the blank at the pitch line, A radius roll, or rolls, or a thread wire 
actually measures the removed metal (or the void across the thread) while 
the cone and vee measures the amount remaining at the pitch line. Further 
examination reveads that thread wires should not be used on product for 
the reason that sll^t surface distortions ailong the flank angle of the 
thread can cause the wire to seat in a ”low“ spot and give an erroneous 
reading when used with a micrometer. Thread wires should only be used 
on plug gages or taps or threaded product where lead end angle and suf- 
face finish are well controlled elements, 

Althou^ the previous paragraphs have discussed briefly some of the 
various means by which an external thread may be checked, it is not the 
writer's intent to iii^ly that these constitute all known methods. These 
cited types of gages and coi^parators are the more commonly used today. 

It is our basic contention that all mechanical devices used for the 
measuring of male screw threads, in order to be technically correct, 
should emminate from the principle of the Go thread ring gage and the 
Pitch micrometer. The purpose sought in discussing these various means 
is to point out the technical and economic limitations and advantages 
in each type of gage so that those who are concerned with implementing 
their SQC programs, relative to the production or inspection of screw 
threads, with correct and effective instrumentation will have a better 
knowledge of which type, or types, of equipment to use. 

It cannot be stressed too vehemently that a control chart is absol- 
utely no more valid than the means by which the data for it is compiled, 
and that hinges directly on the selection and use of effective instrum- 
entation, If a gaging system which conceals error is used, then a very 
false picture of a hl^ quality level will be the result. This condit- 
ion cannot be tolerated if one is to advantageously apply SQC. four 
customer goes not by the appearance of the control chart, but by the 
actual acceptability of the purchased items. The inspection department 
is the customer's representative and management's guardian, and it is 
only as efficient as the inspection equipment used. 

Finally, we have observed that quality can be only the result of 
coarrectly applied instrumentation. When we do this on a statistical 
basis then, and then only, do we have the statistice^. control of product 
quality. One can have sii^le quality control without ever seeing a 
control chart, but that is not the intent or purpose of SQC, It is much 
more of a challenge for a statistician to be syD[q[>athetic to the practic- 
al demands of the manufacturing or inspection departments than it is for 
a machinist or an inspector to be able to ccmprehend the various axioms 
of frequency distribution, probabilities, etc. Many clinics have been 
run on an in-shop and local level to acquaint operators with the theories 
of SQC, and with success. Perhaps more should be organized for the one 
purpose of acquainting SQC people with modern instrumentation means. 
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Without statistics one irarely has a form of cpnt3rol; without affective 
instrumentation 9 quality becomes no more than an imaginative q^mapdity 
on a chart basis. 

It may well be that the difference betwii^n the succeM.^^^^ 
of an SQC program could lie in the fact that too much attention was 
given to statistics and not enou^di thought was given to effective and 
proper instrumentation. Most assinredly, the converse mi^t also be 
triae. We must recognize that the coupling of effective instriimntation 
and a sound statistical basis are the two basic in a true 

statistical quality control operation. Gages which conceal rather than 
reveal (Refects are of no they give false data for chains and poor 
quality of shipments; When^ and only when^ we give adequate |nd real<- 
Istic attention to both phases in this program, then we have Iqc. 
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A RANDOM SAMPLE OF CONTROL PHILOSOPHY : 

Karl J. Bauer 
Abbott Laboratories 

The paper vdLll trace control procedures and philosophy from the 
pre-Statistical Quality Control era thru the maze of charts and data 
to the present simplified methods actually in use. Particular 
emphasis is placed on simplicity, training and a program of ^ality 
Attitude whi.ch attain the desired results. 
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QUAurr coiiTROL’s oBisQiTioK TO 

Captain Ross ?• Maiiachek^ US Kaysr 
Bureau of Aeronautics, Navy D^artment 

For military aircraft and equipment, it is especially true that 
attaimnent of a high measure of quality at the time of acc^tance is not 
an end in itself* It is only a step toward the prime objective of effec- 
tiveness of the item in military use. On that basis we n^ 

ourselves a pertinent question: Are we concentrating on control of qua- 
lity based strongly on factory and laboratory experience while achieving 
only slow development of the feedback of coiisiniier e^qjeriencet 

Such an unbalance could easily occur* Quality measuremients xsp to 
the factory door are relatively easier, handier, more orderly, more sat- 
isfid.ng, and better developed* In contrast, feedback of consumer exper- 
ience, from events scattered around the M world and scattered 

along the calendar, is difficult to obtain and is laced 
cases aiid guesswork* It has been slow in development and has been gen- 
erally frustrating, ¥e talk much more about our factory experience and 
calculations than about the We tend to measure pur 

successes by using factory measurements and tests* These are firm 
and iimnediate than the inf or^ on ultimate effectiveness wW 

receive from the military consumer months later and involving widely 
varying eiivironments. 

¥e receive oiily a part of the vital statistics cpncerni^^ the qua- 
lity and reliability of our equipment in the consumption phaSe of its 
life. Ejccept for the liiJdted areas coyered^^^^^ty Service R^resenba- 

tives it is only when the faults are fdLrly severe or direct]|y trouble- 
some that unsatisfactory reports will be volunteered by the liters* 

Let us consider the numerous lesser cases of faulty mandTacturi^ or 
inspection* They tend to go undiscovered or to go unreporte4 if 
discovered* Even when feedback repoarbs on them do come in, are 
often hard to handle in scattered small quantities* Some are^ a^ 
in phrasing. A considerable number are obviously the work of persons 
trained only in otlier fields* Some are even slanted tward ^suming 
faulty manufacturing or design weakness when faulty handling by the user 
is actually involved. Only when a fairly full coverage is received will 
it be practicable to discern a pattern vpon which correctipn pf non- 
'critical faTilts can be justified* The manufacturer thus fin^ little 
basis upon whidh to make iirprovements or correctioixs of thesf urproven 
lesser faults* The contracting activity likewise does not hive enough 
basis to drive for inprovenBnt of an fipparently nebulous condition* 

Why worry about these lesser faults which have i^ot beep .forcing us 
to action? l^hy go looking for minor troubles 'Khen there are i^jor fli^t 
safety troubles to work on? The answer is that the total pf these nume:?- 
ous lesser faults may well accumulate to an appreciable total equivalent 
of consumed dollars or lessened effectiveness* This Ipss uriL^t be re- 

duced by investing a much smaller sum in mass methods of obtaining more 
detailed discovery, reporting and corrective action* IHarth the 

dominant goal of effecrbiveness at the fron^^^ line may well be ' helped 
throixgh a gradual concurrent rise in basic reliability of the article. 

The change in cost or in reliability will not be great in the avera^ 
case, but the number of profitable cases may well be very large* WO 
percent gain could be considered small but two percent of $5 Mllion is 
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still a $100 million utiich Justifies a considerable effort. A modest 
percent improvement in econonor or reliability from increased cultiva- 
tion of this concealed area will seem more promising when we consider 
that our initial lack is only of information and practicable mass 
communication and not lack of technical ability to talce profitable 
action thereafter. 

Now let us briefly examine some of the action already taken or under- 
way. First of all^ we are not talking of a new problem. Action has 
been underway for decades. It was only stunted in its resttlts the 
fact that the information tended to remain stubbornly concealed in the 
grass roots. The cost of releasing it, by methods then known, seemed 
hi^er than the potential savings. 

The two valuable tools recently applied to these field and factory 
reports of faults are the electric punch card and statistical methods. 

A number of airframe and aircraft equipment contractors are among those 
manufacturers who have been €pplying the punch card for several years 
with varying but encoura^ng degrees of success. As an exanple, one of 
the successful users, an aviation manufacturer, recently reported eisc- 
cellent results in his 3rd and Uth years of such application. However, 
his initial 2 years of application had included a characteristic period 
of deep discouragement arising from the unforeseen volume of reports 
which ovemdielmed the original set-up and from the usual tei^porary skep- 
ticism of many personnel idiose cooperation was needed but could be won 
only after a demonstration of some successfiil results. 

The Navy Bureau of Aeronautics has, for over a year, been ^plying 
electidc punch cards to a new sinplified **Failure or Unsatisfactory Re- 
port" form called a FUR. The pencil-checked FURs, originated at hundreds 
of operating activities, are mailed to a central point, converted to pxm- 
ch cards and then mailed directly to the prime contractor. "When the or- 
iginator also anplifies his pencil checks with worded comment or photo- 
graphs then a 35inm transparent film reproduction of the entire report is 
included right in the punch card. Echo information of any resultant 
manufacturer's action goes back later to the originating activity to en- 
courage future reports and to forestall that frustrating feeling that 
"nobo^ cares". The volume of FURs has already reached high levels and 
the ear3y characteristic discouragement period has occurred but now 
seems to be receding. 

The airframe manufacturer noted above has recited that the FUR 
system cut his average data feedback time to of its former length. 

The volume of reports on conparable numbers of his aircraft increased by 
hundreds of times and the resulting comparative data helped him in the 
solution of basic problems. The FUR data enabled better comparative 
evaluation of the service capability of vendor items. He was aided by 
the fact that he already had in operation a system of tabulation and 
statistical analysis of related mass data at the time the rush of new 
FDR cards on Naval aircraft arrived. 

In summazy, it now seems more practicable to obtain mass informa- 
tion on the experience of the military consumer of aircraft. The infor- 
mation can be transmitted, sorted and initially analyzed by rapid 
modem mass methods. Selective analysis, leading to corrections or inn 
provements, then becomes feasible. The net result of initial ventures 
looks profitable, at least in the aircraft field and after the initial 
expansion period is survived. 
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